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AESTRACT 



A total of 21, masters or doctoral candidate, 
experienced teachers participated in this full-year teacher education 
program conducted at Ohio University. The specific objectives were to 
provide teachers with: 1) a systematic program of study; 2) a 
substantive background in economics with emphasis on the analytical 
methods; 3) assistance in using these methods of inquiry in the 
development of elementary and secondary social science curricula; 
and, 4) knowledge of the new curriculum materials out of the research 
and development projects. With the purpose of the study to evaluate 
this program the focus was on: 1) the priority of the educational 
needs to which the program objectives were directed; and, 2) the 
program effectiveness and efficiency in meeting these needs. The 
procedures used were based on the model developed by the Center for 
Instructional Research and Curriculum Evaluation (CIRCE). The program 
rationale was analyzed first, then the data were organized around 
three major gestalts including: antecedents, transactions, and 
program outcomes. Formative evaluation of changes during the 
operation of program were analyzed within these gestalts. Monitoring 
occurred on a day-to-day basis with additional data gathered from 
observations made by a CIRCE evaluator who interviewed participants, 
faculty, and administrators. The study revealed that the objectives, 
content, and methods were well-suited for an effective long-term 
program in economic education. (Author/SBE) 
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CHAPTER I 



THE PROBLEM , DEFINITIONS OF TERMS, LIMITATIONS Or THE STUDY, 
AND ORGANIZATION OF THE REMAINDER OF THE STUDY 

The Experienced Teacher Fellowship Program In Economic Education 
and Related Social Sciences, 1969*70, (hereafter designated as the 
E*TFP) was a full-year educational program for experienced teachers that 
commenced in June, 1969, and terminated in June, 1970. The ExTF? was 
sponsored by the U .S. Office of Education (IJSOE) under the Education 
Professions Development Act (EPDA) and administered through the 
Department of Economic Education, College of Business Administration, 
Ohio University. 



I. THE PROBLEM 

Statement of the Problem . It was the purpose of this study to assess 
the worth of the ExTFP in terms of (1) the priority of the educational needs 
to which the ExTFP was directed and (2) program effectivenesa and effi- 
ciency m meeting these needs . The analysis of the EXTFP was organized 
around the program’s (1) rationale, (2) antecedents, (3) transactions, and 
( 4 ) outcomes . 

Importance of the study . The demands for higher teacher salaries, 
special training programs, improved and more versatile facilities, and 
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now, more, and often more costly teaching equipment and materials have 
in recent years increased substantially the coats of education in the 
United States. Federal, state, and local governmental agencies, along 
with some private educational foundations, have contributed financial 
support to meet these demands. Presumably, the Improvements in edu- 
cation that were realized through this added support have produced a 
positive effect on the nation's teachers and learners and the many edu- 
cational Institutions throughout the country that were expected to benefit 
from the changes . 

There is little evidence, however, to indicate that even the more 

grandiose projects and large-scale innovations have produced positive 
1 

results. Furthermore, despite the vast increase in expenditures for edu- 
cation generally, educators have been phlegmatic toward evaluation. 

This attitude is perhaps due in large part, to the fact that sufficient funds 
have not been made available to conduct the necessary evaluation of 
new programs, materials, and innovations in pedagogy coupled with a 
sensitivity of educators toward evaluation. Thus, whereas business 
firms may spend up to zer, percent and more of their gross revenues for 
on-going evaluation, education, America's largest industry, often limits 



See, for instance, an assessment of the effectiveness of Title 1 
Projects by Robert A. Dentler. "Urban Eyewash: A Review of 'Title 1/ 
Yearn,'" The Urban Review. Vol. 3, No. 4 (New York: Center for 
Urban Education, Feb., 1969), pp. 32-33* 
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•valuation of programs and othar changes and Innovations to an esti- 
mated less than one percent of total cost. With federally-funded 
programs, it has become a common practice to limit program evaluation 
to the several pages of the required final report requested from the 
program director. 

Under the EPDA, federal legislation approved in June, 1967, the 
USOE administration began to place greater emphasis on program 
•valuation. The act calls for an annual report on the education pro- 
fession by the commissioner of education to the Congress . Congress- 
men, and in turn the USOE administration. began to demand systematic 
evaluation of special programs because of the vast increases in expen- 
ditures for education under the National Oefanse Education Act (NDEA), 
legislation that was in large part subsumed under EPDA, and the paucity 
of evidence of program achievement or effectiveness* The extent of the 
financial support provided through the USOE is suggested by the USOE 
budget to support programs for teachers in the Basic Studies. Tor, 
instance, the fiscal yaar, 1968, USOE budget for Basic Studios programs 
undtr NDEA was in excess of $34 million for 624 projects and more than 
16,000 participants; budget appropriations for the fiscal year, 1069, in 
tha Basic Studios under EPDA was in excess of $21 million in support of 
297 projects for almost 14,000 participants* 

Reflecting the greater concern over measuresrants of program ef- 
fectiveness , the draft guidelines that wars sent to prospective program 
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directors who planned to submit proposals for program support in the 
Basic Studies under EPDA in 1969 called for in-depth evaluation as an 
important criterion in proposal assessment. It was soon recognized, 
however, that sufficient funds could not be provided to implement such 
plans* and further, that there were an insufficient number of trained 
personnel, evaluation centers, and appropriate evaluation models to 
meet the sudden increase in demand. Thus . the final guidelines were 
altered; the mandatory evaluation requirements found in the draft guide- 
lines were changed to read: 

Applicants. . .may make provision in their proposals for 
independent evaluations of their projects. While such 
evaluations are not required, evidence of provision for 
meaningful evaluation performed by competent personnel 
will be a positive factor in the proposal review and the 
approval process 

Although the evaluation mandate had been lifted temporarily, the as- 
sessment of program worth and effectiveness, measured through the 
use of a variety of evaluation techniques . remained a high priority with 
the staff of the USOE. 

USOE administrators are currently considering an increase in expen- 
ditures for program evaluation more in line with the type of evaluation 
and extent of expendltives for evaluation common in business and Industry. 

2 

Guidelines : The Preparation of Proposals for Education Personnel 
Development Grants. 1968. 1969 . 1970 . (Washington. D. C.: U. S. 
Department of Health. Education, and Welfare. April 26, 1968), p. 10. 
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The direction of future program evaluation in education was suggested 
in the state ments of Joseph Young, Executive Director, National 
Advisory Council on Education Professions, who in testimony before 
the U . s . Senate Subcommittee on Education, criticized severely 
"premature evaluation" along with "almost total preoccupation with 
so-called ’hard data’ developed by the mass use of standardized tests." 
Arguing that present evaluation procedures, that often center around 
scores made on standardized tests, provide only one klne of evidence 
of program effectiveness, Young suggested the need for a variety of 
evaluation techniques to capture the "full sense of a project. 

This study of the ExTFP represented an attempt to Implement 
appropriate evaluation procedures as recommended by Joseph Young. 
Although there are recognized limitations, the study represents an 
effort to assess program worth with attention given to the process that 
shaped the program's outcomes rather than the product alone. The type 
of evaluation model that has been employed may be expected to 
characterize future evaluation plans for similar educational programs. 

Finally, the USOE administration has virtually eliminated summer 
Institutes and year-long fellowship programs for experienced teachers 



3 

Joseph Young. "Hearings Before the Subcommittee on Education 
of the Committee on Labor and Public Welfare." (U. S. Senate, 91st 
Congress, 1st Session, S. 2218, H. R. 514, Part 2.) Elementary and 
Secondary Education Ammendment of 1969, Part 2. (Washington, D. C.: 
U. S. Printing Office, 1969), pp. 1097-1099, passim. 
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In the Basic Studies for 1970-71. Programs In the Basic Studies — 
Including economics, history, sociology, and others — have been 
replaced by teacher programs In bilingual education, reading, civics, 
and drug abuse. Although there appears to be little evidence to sup- 
port any contention that the former programs were unsuccessful, 
inappropriate, or ineffective, there was apparently a greater demand 
for program support in the latter areas. . This study may serve to 
validate or invalidate criticisms of the former programs and suggest 
appropriate evaluation procedures for assessing future teacher programs. 
Directors of funding agencies, especially the USOE, may therefore 
find this study beneficial for future planning and programming. 



II. DEFINITIONS OF TER VS USED 

Rationale. The program rationale indicates the philosophic back- 
ground and basic purposes of the program. Further, the rationale pro- 
vides one basis for evaluating program intents, i.e., for analyzing 
whether the plan developed by the program staff constituted a logical 
step in the implementation of the program's basic purposes. 

Antecedents . An antecedent is any condition existing prior to 
teaching and learning which may relate to outcomes. For this study, 
the antecedents to be analyzed Include (1) program context, (2) curriculum 

ERIC 
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content, (3) program design, and (4) student characteristics. 

Transactions . Transactions are the succession of engagements 

that comprise the process of the program. For this study, transactions 
to be analysed include (1) courses, (1) practicum experiences, (3) 
group processing, and group interaction, and (4) communication flows 
and organisation. 

i 

Outcomes . Outcomes are the consequences of the program. For 
this study, the outcomes to be analysed include (1) measurements of 
changes in cognition and attitude, (2) some overall Impressions , (3) 
employment end statue changes, end (4) institutional affects. 



ExTFP . In this report, the initials ExTFP are used to designate 
the Experienced Teacher Fellowship Program in Economic Education and 
Related Social Sciences, 19(59-70, which was conducted at Ohio Univer- 
sity. Initials are not used vrhen reference is mads to other Experienced 
Teacher Fellowship Program! , including a similar p rogr a m conducted at 

Ohio University, 1967*48. Th# ExTFP should not be confused with 
"The Experienced Teacher Fellowship Program," a general reference to 

the collective programs supimcted under NDEA and EFQA. At times, and 
whan the context la clear, tie EXTFP is referred to as "the program. " 



Fallows . Tbs total group of Fallows ware the twenty-one 

i # V 

experienced teachers who participated in the ExTFP; Fellow designates 
one participant. Occasionally, Fallow is useg synonymously with 
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"participant, " An M.A. Fallow was a program participant soaking tha 
M,A* in Economic Education; a Ph.D. Fallow was a program participant 
and candidate for the Ph.D, in Secondary Education with a concentration 
in Economic Education* 

IQ* LIMITATIONS OF THE STUDY 

Financial constraints. Tha proposal submitted to the USOE re- 
questing support for tha ExTFP included detailed plans for an Internal 
and external evaluation of tha program * However, sufficient funds were 
not made available by the USOE to engage the proposed educational 
evaluation center in the external assessment* (See Appendix A for the 
plana for external evaluation prepared by J. Thomas Hastings, Director, 
Center for Instructional Research and Curriculum Evaluation §3IRCE j a 
document that was also included in an appendix to the original program 
proposal submitted to the USOE.) 

An extensive assessment of the program by an external educational 
evaluation center would have contributed positively to the evaluation 
plans* Under even more elaborate plans, a systematic recording and 
reporting of the opinions of many individuals , including spokesmen for 
society at large, philosophers , psychologists, programmers, and others 
would have helped to validate Jud grants concerning program worth. How- 
ever, except for a two-day campus visit by a CIRCE staff member, the 
plans for external evaluation ware not supported or conducted. 

ERjt 
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Ths Internal plans far program • valuation wan approved by the 
staff of the VSOE, and won expanded to inoluda the major faatursa of 
the evaluation roccmm sorted by the faculty of CBCE. The responsibility 
far tbs evaluation of tha EXTF? mas assumed by tbs author of this study 
who carved also as tha associate director of the E*TFF. 

8ouro«s of InwiltditY * Since the EtfTFP was an educational "train- 
ing" program and not an "experimental" program, internal and external 
sources of invalidity may be identified. Techniques of scientific 
investigations that allow ge ne ra lisations to other populations not 
employed in this study include the lack of (1) randomisation, and (2) 
the necessary oo atrsl - ex per i saental groups. These specifications were 
omi t ted beoause of the nature of the program and, in turn, tha nature of 
the study. 

Randomisation of the program's Fallows was not considered feasible 
beoause the program had specific selection criteria. Given these 
criteria, it would have been difficult to establish oontrol-experlmental 
groups for comparison since no equivalent groups, l.e., programs con- 
sisting of similar students or objectives, oould be identified. It may have 
been possible to compere one fellowship program in economics with an- 
other, but the comparison of one experimen t al group with another experi- 
mental group, rather than with a control group, would have violated the 
procedures for "good" design that justify sxtsrnal generalisation. Further- 

* • v*- , 
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mart, such a comparison would hava perforce csntsrad around student 
behavlorlal outcomes or product while neglecting other pertinent factors 
Including antecedents and transactions . 

Similarly, evaluation studies that rely heavily on "hard" data to 
determine program worth must focus attention on product and achievement 
as measured by scores on standardised teats • Although an analysis of 
test scores may give some indication of program worth and individual 
and group achievement, such studies do not capture- the "full sense of 
a project" or give indication of the process that led to any reported 
achievement . Since educators ere often as interested in how a goal was 
achieved as they are in the fact that It was or was not achieved, it be- 
comes necessary to employ a variety of techniques and to gather data 
from many sources in order to determine program worth. Such process 
data lava utility for replication and future programming. 

In conclusion, it is Important to examine the Itvjltationa of "good” 
experimental design and "hard" data in the evaluation of special training 
programs . Limitations include an emphasis upon product or outcome when 
in many instances educators have a greater interest in process or how e 
goal was achieved, than In the extent to which it was or was not achieved. 
Second, to establish validity In a control-experimental group situation, 
it becomes necessary to hold Independent variables constant and to Uni's 



or efi : inSte- Infernal' 
is Ins 'squats for the 



cnJ.’ external ir.isrfsra.ncs. huch experiments tio.f • 

* 

evaluation of iaralnfcrrg protjfer-nsS’ since* changes and 
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modification* of tho p rog ra m whil* It la in progress ara often nacaauiy 
a ad judicious. Thus* the evaluation of educational training program* 
mu*t be more chart otsristlc of the ongoing evaluation common In industry 
and lea* characteristic of the laboratory research end evaluation common 
to tbs natural adenose and psychological reaearob atudiea . 

E x pa rl ara nt a tl oa with the reaearcb model . The research model 
adapted lor this study baa bean used for curriculum evaluation, but not 
extensively for program evaluation. Furthermore, among the several 
models that have b een developed for ourriculum and program' evaluation* 
there ara few relevant ar readable reaearob atudiea using these models 
available.* However* the faculty of the CUtCE evaluation center that 
deeigned the reaearob modal adapted for this study used ft to evaluate a 
number of apodal programs Including several Title ZD projects • Assistance 
provided by CBQE wee helpful is organising this study and in Impl ement- 



Hd WftlVUMli t^ T i tlr ff vnn t 
mi the failure to measure changes In teaching effectiveness that may 



See* for example, Hobart C. Stake. “The Countenance of Educa- 
tional Evaluation* a Tsachara Colleea Keoordf . (April, U(7), and 
mlmaa graphed* p. 2* end Egon 6. Oube end Denial 1. StufOebeem. 
"Evaluation: The Process of Stimulating, Aiding* end Abetting Insightful 
Adlan," (Address delivered at lira Second National Symposium for Profes- 
sors of Educational Aesearoh* Boulder* Colorado, November 21, lift), 

PP. Mi. (mimeographed) 
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occur as a result of participation in the program. One measure of the 
wouth of the ExTFP will be an indication of increased teacher effective" 
ness as performed by the fellows In the various educational situations 
and circumstances where effectiveness may be measured . Such an 
assessment, which would be difficult to measure, was considered to 
be fur beyond the scope of this study since reliable and meaningful 
measurements cannot be mad* until the passage of et least one yeer. 
Time constraints, coupled with the magnitude of such e study and the 
need for adequate funds* perforce led to the elimination of this follow- 
up evaluation. This study should, however, provide sufficient and 
pertinant data that may make a significant follow-up study feasible 
later, perhaps after the constraints of time and funds have been lifted. 

XV. ORGANIZATION OF THE REMAINDER Of THE STUDY 

Chapter 2 of $hla study is devoted to a review of related research. 
Research procedures employed in the study are presented in Chapter 3. 

of the data ar e g iven in Chapter 4. T he 

summary, conclusions, and recommendations arc presented in Chapter S« 
followed by a bibliography and appendices • 
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CHAPTER II 



REVIEW OF RELATED RESEARCH 

J. Thomas Hastings contends that "Evaluation of educational 
endeavor Is ubiquitous . For instance, the evaluation of educational 
endeavors is made by teachers and students, administrators and cur- 
riculum specialists, and by parents, school boards, school communities, 
state departments of education, and the members of the U. S. Congress. 
Furthermore, this evaluation includes both content and method and covers 
activities that range from the preparation of daily lesson plans, pre- 
sentations, and testing to the planning and implementation of subject 
matter content, curriculum theory, and learning psychology. 

Despite the scope and extent of evaluation, evident at many levels, 
and a wide range of circumstances, decision-making is often charac- 
terized by Intuition rather than analysis. Furthermore, there remains 

indeclslon-ln-eduoation-regardlng-(l)-who-should-e-valuate , (2) wha t 

questions should be asked, (3) what Instruments are appropriate, (4) 
how data should be collected, organized, and analyzed, and (5) what 
costs accompany effective evaluation. With recent increases in expendi- 

*J. Thomas Hastings. Evaluation in the Ideal School. (Prepared 
for the Ideal School Conference Series , Elk Grove Training and Develop- 
ment Center, November 16, 1967), p. 3. (mimeographed) 

O 
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tures for education, funding agencies and the public have a right to 
know if education is producing the desired effects and if the changes 
Induced through new expenditures are in fact improvements. 

Guba and Stufflebeam contend that "educators have made a mas- 
sive response to requirements for evaluation [but] the Increased activity 
alone has not met the need for effective evaluations . They argue, 
for instance, that the evaluation reports of special programs sponsored 
by educational agencies of the federal government contain "impression- 
istic Information" and "anecdotal accounts" that do not guide decision- 
makers. Guba concluded an analysis of thirty-two Title III projects 
with the statement that: 



It is very dubious whether the results of these evalua- 
tions will be of much use to anyone. They are likely 
to fit well, however, into the conventional man’s stereo- 
type of what evaluation is: something required from on 
high that takes time and pain to produce but which has 
very little significance for action. ^ 

Additionally, Guba reported that conclusions from some of the more 

-analytical-evaluation reports -produce d "no signific ant difference . 



^Guba and Stufflebeam, 0 £. cit. , pp. 4-5. 

^Egon G. Guba. Evaluation and the Process of Change . (Notes 
and Working Papers Concerning the Administration of Programs, Title III 
of Public Law 89-10, The Elementary and Secondary Education Act of 1965 
as amended by Public Law 89-750, April, 1967, p. 312 . ) Ibid . , p. 6. 

4 Ibid. 
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Finally, after a careful survey of many evaluation research projects, Guba 
and Stufflebeam report that many evaluation reports fail to provide decision- 
makers with the necessary data for making program improvement and thus 
provide little information of significance to program planning. 

I. THE ASSESS* 4ENT OF USOE-SUPPORTED TEACHER PROGRAMS IN THE 

BASIC STUDIES 

USOE Guidelines for evaluation . In funding special programs for 
teacher education under NDEA and the Higher Education Act of 1965, the 
USOE administrative staff recognized the need for accountability through 
appropriate program evaluation. In general, however, accountability 
for USOE- supported programs centered largely around an assessment by 
the program's director made at the conclusion of the program and in the 
form of a final report. A brief chronological synopsis of the changes in 
emphasis for program evaluation in recent years suggests current concern 
over-progra m accountability and the desire to measure program effective- 
ness through appropriate evaluation techniques. Also, the synopsis 
should help to suggest why there are only a limited number of pertinent 
research studies pertaining to special teacher education programs available 
at this time. 

The director's handbook for Experienced Teacher Fellowship Programs, 
1967-68, made mandatory a final report of each program by the program 
director to be submitted thirty days after the conclusion of the program. 
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The final report, the handbook noted, 

. . .will serve three main purposes: (1) to Inform the office 
about the program, listing all vital statistics, etc.; (2) to 
evaluate the program and to discuss any and all problems — 
and to tell how they were met; and (3) to make suggestions 
for improving the program. (Complete Instructions for the 
report will be sent at a later date.)® 

Instructions for the final report were included in the director's handbook 
for 1968-69 programs to be cited momentarily. (According to a USOE 
program coordinator, some directors have failed to submit reports that 
were due as far back as 1965, five years since these programs termi- 
nated . ) 

A USOE bulletin entitled Guidelines : The Preparation of Proposals 
for the Experienced Teacher Fellowship Program, 1958-69 , made only passing 
reference to plans for program evaluation. In designing the program, 
proposed directors were required to make provision for program evaluation 
and follow-up as suggested by the statement that "some indication should 
be given of the way in which the college or university might expect to 
"evaluate this Experienced Teacher Fellowship Program."® 

A later USOE document, A Handbook for Directors , which was 



^ The Experienced Teacher Fellowship Progra m , A Handbook for 
Directors , 1967 -68. (Washington, D. C.: U. S. Department of Health, 
Education and Welfare, February 1, 1967), p. 21. 

Guidelines , The Preparation of Proposals for the Experienced 
Teacher Fellowship Program , 1968-69 . (Washington, D. C.: U. S. 
Department of Health, Education, and Welfare, October 13, 1967), p. 7. 
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distributed to directors of 1968-69 summer and academic year programs 
gave greater details for the writing of the director's final report. The 
information to be included in the final report also suggested (1) a greater 
concern over the need for effective evaluation, and (2) the nature of the 
elaboration of analysis that the USOE was beginning to require. Directors 
were informed that "at the conclusion of the institute the director's final 
report must be prepared." Further, directors were Informed that the final 
report should 

Set forth what the institute accomplished in order to 
appraise its effectiveness. Insofar as possible the 
aim should be to show how the Institute has made 
measurable Improvement in the qualifications of its 
participants . 

Describe major problems which were encountered and make 
recommendations for the improvement of the institute 
program. 

Include a copy of each statistical report that will be 
furnished by the Measurement Research Center of Iowa 
with appropriate corrections and comments. These 
reports will be sent from Iowa before the institute ends. 

(No other statistical report will be required. 

Besides the request for accurate financial reporting, twenty-two specific 
guides for writing the final report were included in the director's hand- 
book . Although "we do not require a legal brief or even a paragraph 
on each item, " a summary of points for directors to consider included 



^Institute Progra ms for Advanced Studies , A Handbook for Directors, 
Summer 1968 . Academic Year 1968 -69. (Washington, D. C.: U. S. 
Department of Health, Education, and Welfare, December 1, 1967), p.24. 
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USOE-dlrector relations, the director's relations with the university's 
administration, physical facilities, assessments of the effectiveness 
of field trips, participant communication with the director and staff, the 
use and effectiveness of new materials, follow-up arrangements, major 
strengths and weaknesses of the program, problems encountered and 
solutions, recommended changes, the potential Impact of the institute, 
and additional comments.® Although the nature of the "guide” for writing 
the final report could, and usually did, lead to "anecdotal accounts," 
the USOE was not remiss in recognizing the need for program evaluation. 

The EPDA initiated in 1968, subsumed summer institutes and ac- 
ademic year programs in the Basic Studies funded previously under NDEA 
and the Higher Education Act of 1955. An impetus for the evaluation of 
programs supported under this act was Included in the legislation. Section 
503 of the act reads: 

(a) The Commissioner [of Education] shall from time to 
time appraise the nation's existing and future personnel 
needs in the field of education. Including preschool pro- 
grams, elementary and secondary education, vocational 
and technical education, adult education, and higher edu- 
cation, and the adequacy of the Nation's efforts to meet 
these needs . In developing Information relating to edu- 
cational personnel needs, the Commissioner shall con- 
sult with, and make maximum utilization of statistical 
and related information of, the Department of Labor, the 
National Science Foundation, the National Foundation of 
the Arts and the Humanities, State educational agencies, 

State employment security agencies, and other appropriate 
private and public agencies . 




8 Ibid. , pp. 28-29. 
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(b) The Commissioner shall prepare and publish annu- 
ally a report on the education professions, in which he 
shall present in detail his views of the state of the edu- 
cation professions and the trends which he discerns with 
the future complexion of programs of education throughout 
the Nation and the needs for well-educated personnel to 
staff such programs. The report shall indicate the Com- 
missioner’s plans concerning the allocation of Federal 
assistance under their title in relation to the plans and 
programs of other Federal agencies. ^ 

Thus Congress passed into law a mandate to evaluate educational pro- 
grams and the state of education throughout the country. 

The effects of the new legislation and the legislative mandate 
for accountability were soon evident in the guidelines and other di- 
rectives to program directors. Draft guidelines for proposals for spe- 
cial teacher education programs for 1969-70 called for "independent evalu- 
ation," requesting all applicants to 

. . .make provision in their proposals for support of annual 
independent evaluation [which] will be an essential ele- 
ment in the consideration of continuation of project fund- 
ing each year. Arrangements . . .should be made with in- 
stitutions, organizations, or agencies that have no direct 
interest in the subject project. [Further,] . . .continual 
evaluation of projectsJj y their d irectors or other internal 

staff is, of course, an ess entiaiT part^flffo ject manage — 

ment . 10 



^ Education Professions Development Act, Public Law 90-35 . 
(Reprinted by U. S. Department of Health, Education, and Welfare, 

Office of Education, Bureau of Educational Personnel Development, n.d.), 
pp. 2-3. 

^ Guidelines , The Preparation of Proposals for Educational Personnel 
Development Grants , 1968 , 1969 , 1970. (Washington, D. C.: U. S. De- 
partment of Health, Education, and Welfare, n.d.), p. 9. 

O 
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Specifically, the guidelines noted that the annual independent 
evaluations should be addressed to two general points: 

1. An assessment of the priority of the educational need(s) 
to which the project is directed. 

2. An assessment of the effectiveness and efficiency of the 
project in meeting the need(s).^ 

Attempts by proposed directors to conform to the new emphasis on and 
direction of program evaluation resulted in an immediate increase in 
the demand for specialists of educational evaluation. The sudden in- 
crease in demand for independent evaluation, however, overwhelmed 
the supply of trained evaluators, appropriate evaluation instruments and 
procedures, and appropriate evaluation theory.^ 

Recognizing the several factors that would prevent the adequate 
evaluation of proposed programs, guidelines released in April, 1968, 
called "meaningful evaluations performed by competent personnel. . . 
a positive factor in the proposal review and approval process."^ Three 
separate documents pertaining to EDPA projects which were released by 
the USOE staff in No ve mb er,~T96 8 , and during - the ~su mmer ,—19 69 , -contained 



n Ibid. 

^Guba and Stufflebeam, op. cit. , p. 8. 

13 

Guidelines , The Preparation of Proposals for Educational Personnel 
Development Grants, 1968 , 1969 , 1970 . (Washington, D. C.: U. S. De- 
partment of Health, Education, and Welfare, April 26, 1968), p. 10. 
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the same message to program directors on evaluation recommending 
"self-assessment, with the object of Improving their on-going programs." 
Meanwhile "some directors will be allowed to undertake the 'independent 
evaluation’ [but] projects that do not include a plan for independent 
evaluation will not be penalized in any way." 

The citations of shifting policies in the USOE in regards to eva- 
luation do not indicate uncertainty over the need for program evaluation 
but suggest rather (1) a realization by the USOE administration that 
appropriate evaluation requires trained personnel, techniques and pro- 
cedures, and theory, (2) that all three of these elements for appropriate 
evaluation are in short supply, and (3) advancing the science (or art?) 
of evaluation is a costly proposition. The citations suggest further 
that there are at present few evaluation studies that may be consulted 
as models for program evaluation. 

Institute evaluation reports . The survey of evaluation requirements 

found in USOE proposal guidelines and director's handbooks should not 

be construed to imply that the USOE administration has been negligent or 
has not supported evaluation studies of special teacher programs. To the 
contrary, the USOE administration has supported a number of studies 

14 

A Handbook for Directors : Education Professions Development 
Act, (Washington, D. C.: U. S. Department of Health, Education, and 
Welfare, November 15, 1968), p. 10. 
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directed toward a critical assessment of funded programs. 

In May, 1966, the Consortium of Profess ional Associations for the 
Study of Special Teacher Improvement Programs (CONPASS) was formed. 
CONPASS consisted of the five associations that had assessed the 1965 
Title XI institute programs and included in its membership the American 
Historical Association, the Association of American Geographers, the 
Department of Audio-visual Instruction (NEA), the International Reading 
Association, and the Modern Language Association of America. Invitations 
to membership were subsequently extended to, and accepted by, the 
American Economic Association, the American Industrial Arts Association, 
and the American Political Science Association. Through support from the 
USOE, CONPASS has directed several studies of special teacher education 
programs since its inception in 1966 including summer institutes and 
Experienced Teacher Fellowship Programs. 

Examples of the nature of the evaluation conducted by CONPASS 
study groups may be found via a brief review of two evaluation reports 
including (1) a 1965 report on summer history institutes directed by John 
M. Thompson, (a report by an evaluation team commissioned by an 
association that was a charter member but which in fact antedates CONPASS 
by one year) and (2) the report on 1966 summer institutes in economics 
conducted for the Consortium by Jim E. Reese and Robert L. Darcy. 

In contemplating their task, the survey team of fifteen historians 
and specialists in social studies and educational evaluation tried to 
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identify what they believed to be the difference in the forty-eight in- 
stitute programs in history funded in 1965 and regular graduate courses. 
The difference they anticipated was the elusive quality of institute train- 
ing, viz . , "the smell of summer."^ Procedurally, the study was com- 
posed of two complementary parts. First, all institute participants 
were asked to complete a questionnaire, devised by the survey team, 
during the last half of the institute. Second, members of the survey team 
sometimes singly and sometimes in pairs, visited representative in- 
stitutes for two or more days and tried to sample the program of the 
Institute and the attitudes of the personnel associated with it. The team 
members normally tried to attend classes, talk informally with partici- 
pants, and arrange formal interviews with the institute staff and with 
institute participants selected at random. At the conclusion of the visit, 
each team member was required to complete a Survey Report Form to sum- 
marize his findings . 

The data obtained from (1) the questionnaire, (2) the interview forms 
and (3) the Survey Report Forms furnished the factual basis for the report. 
However, to take cognizance of the teams' impressions, a summary 
conference was held in August, 1965, where a rough draft of the compiled 
report was read and commented on by the entire survey team. 

John m. Thompson (ed.). Teachers , History and NDEA Insti- 
tutes , 1 965: Report of a Survey Team. (Washington, D. C.: American 
Council of Learned Societies, 1966), p. 1, 
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The findings of the survey were organized around eleven major 
categories . The Table of Contents of the report gives an indication of 
the major thrust of the survey and the areas that were studied: 

I. History Institutes , 1965 
II. The Participant 

IV. Purpose and Design 

V. Types of Participants 

The Program of an Institute 
Special Design 
Kinds of Instruction 
Approaches to Content 
Work load and Assignments 
Credit and Grades 

VI. Application of Institute Training to Teachers' Classrooms 

VII. Coordination and Integration 

VIII. Role of the Director 

IX. Role of the Staff 

X. Role of the Host Institution 

XI. Relations with the Schools and the Office of Education 

The procedures employed and the areas studied in the comprehensive report 

of history institutes of 1965 may be observed in later evaluation studies, 

thus establishing the survey of the history institutes of 1965 as a precursor 

to later studies and reports. 

The Reese and Darcy report on five economics institutes conducted 
during the summer, 1966, was prepared for CONPASS and represented one 
of several reports of various institute programs evaluated that summer. 
Again, the U-SOE was the sponsoring agency. 

The procedure used in this investigation was similar to the survey 
conducted for the 1965 history institutes. Of the five economic institutes, 
Reese visited three while Darcy observed the remaining two. In each in- 
O stance, the observers audited lectures and class sessions and examined 
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materials prepared by the participants . Further, the team analyzed the 
completed questionnaires that had been prepared and distributed earlier 
through the USOE. Similar to the procedures of the survey team that 
examined the history institutes of 1965, the authors of the report on eco- 
nomics Institutes met for a writing conference shortly after completing 
their respective visits to the institutes; later they met for one day with a 

curriculum specialist to review their findings. 

Because they were of the opinion that " . . - all of the Institute direc- 
tors were experienced in the field of economic education and were selected 
because of this background, an evaluation in the usual sense was unnec- 
essary." instead, the reporters looked for " . . .hints on procedures and 
methods which might be useful to future directors." 16 Specifically, the 
thrust of the report and of the study is suggested by the report's Table of 
Contents which Includes, however, a number of tables and appendices 

omitted here: 



Part I 


- Needs and Objectives 


Part II 


- Institute Personnel 


Part III 


- Content 


Part IV 


- Transfer 


Part V 


- Organization 


Part VI 


- Follow-up 


Part VII 


- Participants 


Part VIII 


- Physical Arrangements and Facilities 


Part DC 


- Observers' Evaluation 


Part X 


- Participants' Evaluation 


Part XI 


- Conclusions and Recommendations 




16 Tim E. Reese and Robert L. Darcy. Regort^ Jh^ 1966_NDEA 
Advanced Study Institute in Econo mlcs_. (No publication information 
given), p. ill. 
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The six pages of the report that comprise the final chapter Include a 
number of observations about the institutes based on (1) the questionnaire, 
(2) the visits, (3) the interviews, and (4) a "number of years of personal 
participation in economic education programs for teachers. . . As with 
the survey of history institutes, the reporters of the economics insti- 
tutes recognized the need to report observations based on their own 
attitudes and opinions rather than to rely completely on an analysis of 
so-called "hard data." 

The evaluation of Experienced Teacher Fellowship Progra ms . Of 
particular relevance to the assessment of the ExTFP are the evaluation re- 
ports of Experienced Teacher Fellowship Programs based on research sup- 
ported by CONPASS for the USOE. The composite study consisting of three 
reports was directed by Walter H. Crockett, James D. Laird, and Joseph 
C. Bentley and administered through Clark University, Worcester, Mass- 
achusetts. The study consists of separate reports on Experienced Teacher 
Fellowship Programs, 1966-67 and 1967-68; a report of 1968-69 programs, 
that may be published in book form, is in preparation. There are no plans, 
however, for a similar report of Experienced Teacher Fellowship Programs 
conducted in 1969-70. 

In a brief Introduction to the 1966-67 report, the evaluation team 
notes that the first guidelines for writing proposals for Experienced Tea- 

17 Ibid., p. 13. 
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cher Fellowship Programs were dated December 27, 1965, the deadline 
for completing proposals was January 20, 1966, a panel of consultants 
evaluated the proposals later in January and the announcement of awards 
was made in February. Some programs began already in June, 1966. 

Reminiscent of the fluctuations in the guidelines and handbooks 
in regards to program evaluation, and more particularly, the celerity 
with which the Experienced Teacher Fellowship Programs were planned 
and instituted, ". . .so, also, were the procedures for studying the pro- 
gram's effectiveness. Barely three months elapsed between the forma- 
tion of a research team and completion of data collection for the present 
report."^® The procedures that were established and followed covered j 
a series of three related investigations over a period of three years . Th!e 
three separate but related studies included (1) a study of questionnaire 
responses to the first year's programs , (2) a field investigation of three 
separate institutions during the second year, and (3) a study of the en- 
tire set of institutions during the third year. 

Specifically, the procedures followed in the 1966-67 study rested 
on an analysis of data obtained from (1) the responses to questionnaires 
administered to individuals involved in the programs and (2) the reports,' 
by teams of evaluators who visited thirty-one of the fifty funded programs . 

Ip 

Walter H. Crockett, et. al. Report of the Experienced Teacher 
Fellowship Program , 1966 -67 (with Appendices). (Washington, D. C.: 
Consortium of Professional Associations for the Study of Special Teacher 
Improvement Programs , 1967), p. 2. 



O 




38 



28 



Separate but related questionnaires, which "borrowed heavily from those 
used in earlier studies on summer institutes," were administered to (1) 
the participating Fellows, (2) all full-time faculty members and randomly- 
selected part-time faculty members, (3) program directors, and (4) the 
director of teacher education on each campus. The questionnaire admin- 
istered to the participating Fellows and the faculty contained sixty differ- 
ent items; the questionnaire for program directors contained an additional 
ten items relative to the administration of the program. Responses to the 
questionnaire administered to the directors of teacher education were 
spotty and therefore not discussed in detail in the report. 

The evaluation teams normally consisted of three individuals, in- 
cluding (1) a specialist in the subject matter of the program, (2) a special- 
ist in teacher education, and (3,) a teacher experienced in the subject area. 

/ 

' / 

After a meeting with the research staff, members of CONPASS, and repre- 
sentatives from the USOE, the evaluation teams spent two days on their 
assigned campuses where they met with program participants, the faculty, 
and administrators; further, they visited classes and reviewed the general 
operations of the programs. Subsequently, each team member individually 
completed a twenty-four item Visitors Evaluation Form for rating the pro- 
gram visited. Each evaluator was further asked to provide a written an- 
alysis explaining his rating; a combined evaluation by each team was also 
submitted, this report representing a team consenus. 

Since the evaluation techniques and the questionnaires were similar 
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to those used for institute evaluations, the structure of the report is 
similar to the structure of the institute reports. Besides an introduction 
and overview, the report centers around a study of (1) participant, 
faculty, and program characteristics, (2) reactions to and impressions 
of the programs, and (3) correlates of effectiveness and satisfaction. 

(This organizational pattern resembles the major categories found in the 
CIRCE Model, discussed below, which includes (1) rationale, (2) 
antecedents, (3) transactions, and (4) outcomes.) The authors of the 
report used graphs and tables more extensively in reporting the data than 
the authors of the institute reports had used, thus making the report more 
formal and impersonal. 

The techniques employed in the investigation of the 1967-68 programs 
were similar to the procedures used in 1966-67. However, the team visits 
to many campuses were replaced by intensive studies of three programs. 
Data collected from the three in-depth studies were included in the report 
largely for illustrative purposes. The content of the questionnaires was 
borrowed heavily from those of the preceding year. 

The structure of the 1967-68 report deviates noticeably in one respect 
from the earlier report. The report consists of four parts that include (1) 
an introduction and overview of findings, (2) general background infor- 
mation and a survey of the educational values and beliefs of the Fellows, 

(3) an analysis of the perceived effectiveness of the individual programs 
along with the correlates of effectiveness, and (4) a consideration of 
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the implications of the data for teacher training and for higher education 

in general. Of particular significance in the 1967-68 report is the last 

section that deals with implications. The authors begin this thirty-two 

page section with the comment that, "Ordinarily, we would end this re- 

1 Q 

port with the last chapter." It is particularly in this portion of the 
report that the personal opinions of the authors — based on the collected 
and analyzed data — becomes evident and resembles more closely the less 
formal reporting found in the reports on summer institutes . Stated dif- 
ferently, there is in this section less reliance on the responses made to 
questionnaires and a greater reliance on personal opinion that was based 
upon familiarity with the programs and the findings. 

Besides the reports on Experienced Teacher Fellowship Programs 
conducted through CONPASS, the USOE administration sponsored other 
evaluation projects. In 1968, for instance, the USOE supported a short- 
term evaluation institute for fourteen "Alumni Fellows" who represented 
five Experienced Teacher Fellowship Programs in history and the social 
sciences. This group of experienced teachers met at Carnegie- Mellon 
University " . . .to discuss ways in which Fellowships in history and the 
social sciences might be improved." They commented that program assess- 
ment based on data obtained from questionnaires, site visits by specialists. 



^Walter H. Crockett, etal. Teachers as Students : Report on 
the Experienced Teacher Fellowship Program, 1967-68. (Washington, 
D. C.: CONPASS, 1968), p. 99. 
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and national meetings for veteran directors" . . .assumed that final 

2 0 

responsibility for assessment lies beyond the participants." 

The authors of the report acknowledge the importance of the assess- 
ments of Experienced Teacher Fellowship Programs supported through 
CONPASS, but note also that "these studies have been restricted largely 
to the collection and evaluation of data that can be quantified and there- 
fore do not necessarily help to determine whether or not instruction in 
the schools has changed."^ Further, the authors note that there may be 
particular significance in their report since each participating Fellow had 
completed a year of teaching following participation in an Experienced 
Teacher Fellowship Program. 

The report consists of twenty-five recommendations directed toward 
better and more appropriate programming. The recommendations represent 
the collective opinions of the Alumni Fellows based on their experiences 
in the various programs they participated in and a post-program year of 
secondary teaching. The study provides an example of an evaluation report 
based on opinions and experiences rather than an analysis of quantified 
data by professional evaluators and educators. 

A recent example of efforts to encourage appropriate program evaluation 

20 

Judith Cochrane, et al. A Report on the Evaluation of the Experi- 
enced Teacher Fellowship Programs in History and the Social Sciences , 
1966 -67. (June, 1968), p. 1. (mimeographed.) 

21 Ibld. , p. 4. 
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was the USOE sponsorship of five short-term (five day) evaluation 
Training Programs at four sites supported through the Bureau of Edu- 
cational Personnel Development, Directors of 1969-70 programs in the 
Basic Studies, including the directors of Experienced Teacher Fellowship 
Programs, were eligible to apply for those programs which were held 
during the summer, 1969; to encourage participation, the directors were 
allowed travel and a per diem under their EPDA grants . A memorandum to 
Basic Studies directors from Mrs. Iris Garfield, Director, Division of 
Assessment and Coordination, USOE, and dated February 6-7, 1969, in- 
formed the directors that the Training Programs 

. . .will be designed to encourage each director to undertake 
'independent evaluation' of their training programs, as re- 
ferred to in EPDA guidelines . It is hoped that the directors 
who participate in the Training Programs will gain an under- 
standing cf how evaluation can assist in improving project 
operation. In addition, project directors should develop an 
understanding of the limitations of self evaluation and the 
need for the use of outside consultants . 

Directors should be oriented to the use of program evaluation 
as a means of obtaining information about their programs, to 
facilitate correction during the course of the programs, and in 
general to aid in pertinent decision making. 

To achieve the objectives stated in the memorandum, the Training Program 

staff members introduced the program directors to evaluation techniques, 

often emphasizing the mode, s developed at the evaluation centers where 

the sessions were held. 

Sessions at the Training Program at Ohio State University, for in- 
stance, directed attention toward an evaluation model that centers around 
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the study of a program's Context, Inputs, Process, and Product, com- 
monly known as the CIPP Model. The Training Program at the University 
of Arizona placed greater emphasis on an evaluation model for Evaluative 
Programs for Innovative Curriculums (EPIC), a model developed at the 
EPIC Evaluative Center. 

The Impact upon program evaluation made through these efforts is 
hard to measure, at least at present. So, too, it is difficult to know if 
the objectives forwarded by Mrs . Garfield were achieved. In any event, 
the administrative staff of the USOE has shown concern over evaluation 
and has supported projects directed to that end. However, along with 
the decision to discontinue Experienced Teacher Fellowship Programs and 
summer institutes in the Basic Studies, at least in the discipline areas 
formerly supported, so, too, the USOE administration has no plans to 
support additional special Training Programs in evaluation techniques. 

II. MODELS FOR EVALUATION 

Besides the evaluation reports based on teacher education pro- 
grams in the Basic Studies, ruch as those cited above, and the final 
reports prepared by progra m directors , there are available the final re- 
ports prepared for other types of programs funded through outside agen- 
cies and prepared by the directors of these projects. For instance, there 
are the final reports of the projects funded under the several titles of the 
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Elementary and Secondary Education Act (ESEA) . A review of these re- 
ports is, however, of dubious value. In their criticisms of Title I reports, 
for instance, Guba and Stufflebeam note that these reports ". . .usually 
lacked the level of credibility required by decision-makers to defend 
their decisions, and seldom has such information been of material use 
in arriving at important decisions . " Besides their own criticisms over 
the value of many of the Title III reports, Guba and Stufflebeam note that 
the USOE has consistently ranked evaluation near the "poor" end of a 
five-point scale for rating fifteen project elements. The only criteria of 
project achievement receiving a lower rating than evaluation was the 
criteria related to dissemination.^ 

An example of another type of evaluation is the report prepared by 

David W. Beggs which is descriptive of a series of innovations in the 

administrative, teaching, and curriculum designs in the Decatur-Lake- 

24 

view (Illinois) High School. This well-formulated report describes (1) 
the philosophical basis for the changes that were contemplated, (2) the 
change process as the plans were implemented, (3) the successes, 
failures, and modifications of the plans during the change period, and 

22 Guba and Stufflebeam, op. cit. , p. 5. 

2 ^Ibid. , p. 6 . 

24 

See David W. Beggs. Decatur- Lakeview High School : A Prac- 
tical Application of the Trump Plan, (Englewood Cliffs, N. J.: Prentice- 
Hall, Inc. , 1964.) 
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(4) some conclusions and recommendations based on the experiences 
at Decatur- Lake view. 

The organizational pattern of the study of the Lakeview-Decatur 
program is perhaps closer to the nature of appropriate evaluation as ad- 
vocated by evaluation specialists than many other studies. However, a 
survey of evaluation theories may perhaps serve a better purpose than a 
further review of reports that have been prepared and which (with some 
exception, as suggested by some of the studies reviewed above) neither 
contribute greatly to the literature on evaluation and assessment nor 
relate specifically to long-term teacher education programs. 

Evaluation defined . Professional education evaluators have defined 
evaluation in a number of ways including dictionary definitions, formal 
definitions, and working definitions. The definition accepted or proposed 
by a given evaluator often serves as the basis for the evaluation model 
prepared by that evaluator, thus making the definition the basis or particu- 
lar frame of reference used in the construction of the model. In some 
instances, differences in the definitions indicate a major difference or 
point of departure among the evaluators whereas in other instances the 
definitions simply indicate a slight distinction or shift in emphasis. 

It is not the intent of this report to enter into any disputes that may 
exist among professional evaluators or to examine in detail the merits of 
the various definitions used or the models that flow from these definitions. 
Rather, It is the purpose of this review to suggest some of the variations 
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among definitions and to give some indication of the common elements 
among them. The procedures and major emphasis of this study will 
emerge from this review. 

The structure and techniques for evaluating special teacher pro- 
grams and curriculum projects were developed in the mid-1930's by Ralph 
W. Tyler, director of the evaluation of the Eight-year Study in secondary 
education. Tyler’s major concern in evaluation centered around a method 
for determining the extent to which the educational objectives of a pro- 
gram were actually realized . In other words , evaluation was looked up- 
on as a process by which initial expectations established in the form of 
behavioral objectives matched educational outcomes. By "extent," Tyler 
required a measure of percentages of students, objectives, and attain- 
ment. Stating objectives clearly and in behavioral terms became neces- 
sary in order to make the necessary measurements at the conclusion of 
a program. 

The idea of evaluation as a product control as advocated by Tyler 
and his associates implies that the aim or objective of a program serves 
as the terminus for activity, and further, gives rise to assessment based 
on scores attained on standardized tests as a major criterion in program 
evaluation. John Dewey, already in 1922, questioned the validity of 
evaluation based on the stating and later measurement of attainment of 
stated objectives. Dewey suggested that objectives ". . .are not ends or 

termini of action at all. They are ter ninals of deliberation, and so turning 
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25 

points Inactivity." Despite some dissent, however, the dominant form 
of evaluation for many years was based on the model developed by Tyler 
and his associates in the 1930’s, 

Starting In the early 1960's, specialists in curriculum and program 
evaluation around the country began to question the completeness of the 
approach attributed to Tyler. Perceiving objectives as turning points 
rather than end points, and that behaviors are often manifested after for- 
mal education has been completed, the evaluation specialists began to 
examine the process of a curriculum or special teacher program and to 
emphasize the need to describe the activities involved during the opera- 
tion of the project. Through this emphasis, they supported Dewey's claim 
that "even the most important among all the consequences of an act is 
not necessarily its aim." 2 ^ They showed concern, too, over the element of 
process emphasized by Lee J. Cronbach who argued that it is "not to in- 
quire merely whether the course is effective or ineffective. Outcomes of 
instruction are multi-dimensional, and a satisfactory Investigation will map 
out the effects of the course along with dimensions separately. " 27 Thus, 



^Herbert y . Kliebard. "Reappraisal," The University of Chicago 
School of Review. (Volume 78, No. 2, February, 1970), p. 268, citing 
John Dewey. Human Nature and Conduct . (New York: Random House, 
1922), p. 223. 

26 Ibld. , p. 269. 

27 Ibid . , p. 235, citing Lee J. Cronbach. "Evaluation for Course 
Improvement,” New Curricula , ed. Robert W. Heath. (New York: 

Harper and Row, 1964.) 
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the most significant dimensions of an educational activity, or any 
activity, came to be looked upon as any event or occurrence, even 
those that were completely unplanned and wholly unanticipated. Eval- 
uation procedures that ignored process and that failed to examine the 
full scope of a curriculum or program came to be considered unsatis- 
factory . 

Recognizing the importance of process evaluation and the need 
for rational decision-making while a program is in operation, Guba and 
Stufflebeam suggest five steps that influence program decisions and 
operations; these decisions and operations are in turn evaluated, ad 
infinitum. The five steps include 

(1) focusing the evaluation to identify the questions to be an- 
swered and the criteria to be employed in answering them, 

(2) collecting information, (3) organizing information, (4) 
analyzing information, and (5) reporting Information. 2 8 

Figure 1 provides a visual representation of the relationship of evalua- 
tion to decision-making. 

With decision-making established as evaluation's raison d' etre , 

Guba and Stufflebeam define evaluation as follows; 

EVALUATION IS THE (1. PROCESS) OF (2. OBTAINING) AND 
(3. PROVIDING) (4. USEFUL) (5. INFORMATION) FOR MAKING 
{6 . EDUCATIONAL DEC ISIONS) . 2 9 

The terms in the above definition of educational evaluation are further 



29 Guba and Stufflebeam, op. cit. , p. 20. 
29 Ibid., p. 23. 
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defined as follows : 



1. Process . A particular and continuing activity subsuming 
many methods and Involving a number of steps or operations. 

2. Obtaining . Making available through such processes such as 
collecting, organizing, analyzing, and reporting answers such 
formal means as statistics and measurement. 

3. Providing . Fitting together into systems or subsystems that 
best serve the needs or purposes of the evaluation. 

4 . Useful. Appropriate or pre-de ter mined criteria evolved through 

the interaction of the evaluator and the client. 

5 . Information. Descriptive or interpretive data about entities 

(tangible or intangible) and their relationships . 

31 

6. Educational decisions . A choice among alternatives . 

The evaluation model that evolves from Guba and Stufflebeam defi- 
nition of educational evaluation will be described below. 

A second definition of evaluation, which contains an added dimen- 

32 

sion, is based on evaluation methodology advanced by Michael Scri.ven. 
Scriven's approach to evaluation emphasizes the need for assisting edu- 
cators in rational decision-making, but is coupled with a call to evalua- 
tors to arrive at conclusions over program worth. This emphasis forms the 
philosophical basis for the evaluation model developed by Robert Stake, 
Associate Director, Center for instructional Research and Curriculum 
Evaluation, and a definition of evaluation suggested by CIRCE director, 



3 *Ibid . , p. 24. 

32 

See Michael Scriven in Ralph W. Tyler, Robert M. Gagne, and 
Michael Scriven. "The Methodology of Evaluation," AERA Monograph 
Series in Curriculum Evaluation. Perspectives of Curriculum Evaluation . 
(Chicago: Rand McNally &Co., 1967), pp. 39-83, passim . 
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J. Thomas Hastings. Hastings contends that 

Evaluation consists of a complex of collecting information and, 
through the use of standards, making judgments about the 
goodnes s -badness , the appropriatenes s -inappropriateness , the 
efficiency-inefficiency of materials, acts, relationships, and 
outcomes . A basic purpose of evaluation is to move decisions 

O O 

toward the rational and away from the intuitive and unconscious. 

As stated by Scriven, "It's his [the professional evaluator's] task to try 
very hard to condense all that massive data into one word: good or bad . "34 
Although professional evaluators have written different definitions 
of evaluation and from these definitions have developed different pro- 
cedures and models, there are a number of common elements among the 
various definitions and techniques. Among other areas of agreement, 
professional evaluators of the 1960's point to the need for (1) stating obj- 
ectives clearly (although not necessarily in behavioral terms), (2) de- 
scribing process as well as product, and (3) assisting educators in 
decision- making . 

There are also differences in the recent approaches to evaluation 
that have been formulated, and a shift in emphasis from the earlier 
techniques . As recognized by Scriven, there are philosophical and 
practical inadequacies in the "Current conception of evaluation of edu- 
cational instruments." He notes further, however, that "intellectual 



33j. Thomas Hastings, op. cit. , p. 2. 

Michael Scriven. "Evaluating Educational Programs: A sym- 
posium," The Urban Review , (Volume 3, No. 4, February, 196b;, p. 22. 
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progress is possible only because newcomers can stand on the should- 
ers of giants. This feat is often confused with treading on their 



A review of two evaluation models . Professional educational 
evaluators have in recent years developed evaluation structures or 
models as guidelines for the systemic assessment of the effectiveness 
of a curriculum or educational program. Despite variation among these 
models, there are several common elements including an emphasis on 
process, decision-making, and total program assessment. Some of 
the major characteristics, similarities, and variations are suggested in 
the review of educational evaluation models that follows . 

The EPIC Model, identified by the sobriquet "cube,” was designed 
by the staff of the EPIC educational evaluation center, University of 
Arizona. The purpose of the model, portrayed in Figure 2, is to assess 
innovations in curriculum design. 

Forces affecting innovation are described in terms of specific 
variables and factors operating in the three-dimensional structure. The 
interaction of variables from each of the three dimensions produces com- 
binations of variables , identified as factors , to be considered in the 
evaluation of a given program. Since an instructional program is affected 

35 Michael Scriven, oj>. cit. , p. 39. • / 
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FIGURE 2 

THE EPIC STRUCTURE OF VARIABLES INFLUENCING 
INSTRUCTIONAL PROGRAMS 36 



by many variables, from within and without, the evaluator may more 
easily visualize these variables when they are organized in such a way 
that he can recognize combinations of variables that may affect the out- 
come of an Instructional program. 



^Robert J. Armstrong, et. al. (ed.). Developing and Writing 
Behavioral Objectives: A Handbook Designed, to, Increase ^Communi- 
cation of Laymen and Educators . (Tuscon, Arizona: Educational Inno- 
vators Press, Inc., 1968), p. 11. 



44 



As Figure 2 suggests, the EPIC structure consists of three major 
variables including (1) institution, (2) instruction, and (3) behavior. 

These major categories are broken down into smaller components which 
in turn provide a framework to Identify the forces affecting a given pro- 
gram. In the detailed assessment of a given program, any single cube 
may be removed from the larger block and analyzed in depth for evaluation 
purposes. Figure 3, illustrates how variables may be identified and 
combined into factors, thus representing a combination of one variable 

drawn from each of the three dimensions. 




FIGURE 3 
EPIC FACTOR 37 
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"The EPIC Brief." (Tucson, Arizona: EPIC Evaluation Center, 
n.d.), p. 7. 
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The above brief summary of the EPIC model does not treat the process 
or steps Involved in conducting an evaluation. It does , however, serve 
to Identify some of the major characteristics and emphases of the 
evaluation model developed and Implemented by the staff of the EPIC 
Evaluation Center. 

The process and logic underlying the model that appears In Figure 4 
Is explained step-by-step by Cuba and Stufflebeam In the manuscript cited 
several times earlier. This structure, known as the CIPP model, flows 
naturally from Cuba and Stufflebeam's definition of evaluation which was 
given earlier. The model itself represents a total evaluation system based 
on a detailed discussion of the several components that make up the whole. 

In brief summary, the outer loop of the CIPP model represents a 
continuous, systematic context evaluation mechanism that serves as a 
feedback system. When no recognized discrepancies exist between pro- 
gram intentions and actualities, or between possibilities and probabilities, 
no changes are made In the program or curriculum plans. This Is 
Illustrated in the model as the context evaluation system In which the 
program continues In a state of "enlightened persistence." However, In 
the event that changes in a program are judged to be wise or necessary, 
the nature of the change must be identified. 

Upon Identification of the desired change, the evaluator may (1) 
make necessary adjustments without extensive research, or (2) turn to 

Input evaluation, l.e. , a search for information a^out strategies and 
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procedures that may be employed to effect the desired changes. The former 

choice leads to a relatively simple restructuring of the program. The latter 

alternatives cause the evaluator to move toward process or product 

evaluation. Process evaluation provides the evaluator with information 

for implementing the decisions needed for efficient operation of the 

changes , including possible recycling of structuring decisions. Product 

evaluation, according to Guba and Stufflebeam, 

. . .would go simultaneously throughout the process of the trial 
in conjunction with process evaluation and would support recy- 
cling decisions which could lead to a reformulation of the change 
to be brought about, a modification either in strategy or procedure, 
termination of the change effort or, in the installation of the inno- 
vation in the total program. In the case of installation, again, the 
context evaluation mechanism would be adjusted so as to allow 
systematic monitoring of the new element in the total system. ^9 

It is through the Implementation of these procedures that decision-makers, 

evaluators and educators , are directed to more rational choices and more 

effective programming . 



The CIRCE Evaluation Model . Because the procedures used in this 
study are based largely on the CIRCE Model, a more detailed summary of 
this model and its rationale follows. Robert E. Stake, associate director 
of CIRCE and principal author of the model, described the model Initially 
in the April, 1967, edition of Teachers College Record in an article 



S ^Ibld. , pp. 66-67. For a complete description of the CIPP 
evaluation model, see Ibid., pp. 20-67. 
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entitled "The Countenance of Educational Evaluation." In this and sub- 
sequent articles , Stake acknowledges a heavy reliance on the evaluation 
procedures advanced by Michael Scrlven. 

According to Stake, meaningful evaluation of educational programs 
must be based on an examination of the full countenance of evaluation. 

He recognized that informal evaluation is sometimes penetrating and in- 
sightful, but that a need exists to search for relevant data that are per- 
tinent to ultimate decisions regarding program worth. To make relevant 
and rational judgments about a program, it becomes necessary to examine 
the contingencies that exist among background conditions, classroom 
activities , and scholastic outcomes . Figure 5 contains a layout of state- 
ments and data to be collected by the evaluation of an educational program. 

Evaluation broadly conceived must consider both a description and 
a judgment of the program under investigation, i.e., an analysis of the 
program based on a description of program intents and observations which 
may be judged against standards of excellence or a descriptive analysis 
of comparable programs . Thus, the full countenance of evaluation extends 
beyond the administration and normative interpretation of achievement tests. 

Whether in the descriptive or judgment phase of evaluation. Stake 
identifies three major bodies of information or gestalts that should be 
examined including (1) antecedents, (2) transactions, and (3) outcomes. 
Antecedents may be identified as those conditions that exist prior to the 
program and which may relate to the program outcomes. Transactions in- 
clude those events that occur while the program is in process. Outcomes 
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may be identified as the consequences of the program and nay be imme- 
diate or long range, cognitive or conafcive, personal or community-wide. 

As Figure 5 indicates, the various elements of educational evalua- 
tion, including descriptive and judgmental data, may be classified and 
recorded in an appropriate cell. 

The program intents include, and are synonymous with, program 
goals and objectives. Observations may be made in a direct and per- 
sonal way or through the use of Instruments. Contrary to Intents, how- 
ever, a description of observations Includes those events that occur or 
are realized while the program Is in operation, even those side-effects 
that were not planned when the program was initiated and were not, there- 
fore, Included as goals of the program. 

Before considering the judgment matrix of the CIRCE model, the 
format for processing descriptive data should be noted. As suggested 
in Figure 6, descriptive data may be processed by identifying the con- 
tingency among antecedents, transactions, and outcomes, and the con- 
gruence between intents and observations . 

Contingency among the variables suggests a relationship that may 
result in program improvement. Since a major function of evaluation Is 
program improvement. It becomes the evaluator's task to identify those 
outcomes that are contingent upon particular antecedents and transac- 
tions . Therefore, the program evaluator searches for the logic that may 
connect an event with a purpose; he records this event as a logical 
contingency. 
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Congruence does not imply that intended antecedents, transactlohs , 
and outcomes are fulfilled oir that judgments concerning outcomes ere 
reliable or valid. Discrepancies that may exist between intents and 
observations are sometimes a desirable condition. Reporting congruence, 
then, is simply to indicate that what was intended did occur. 

In the judgment matrix of the CIRCE model, the evaluator records 
program judgments and identifies the standards against which these 
judgments were made. Since there may be many criteria in making judg- 
ments and in deciding what standards and whose interpretations of these 
standards should be used, it becomes necessary for the program evaluator 
to specify quite clearly his evaluation criteria. 

In making program judgments, Stake expresses regret that even 
some of the best trained evaluators have been looking at education with 
a "microscope" rather than with a "panoramic view-finder;" because of 
this approach they have not captured the full sense of a program. Fe 
suggests that in judging the characteristics of a program, both the edu- 
cator and the professional evaluator must gain a perspective of the total 
program and clearly distinguish between evaluation based on (1) absolute 
standards as reflected by personal judgments and (2) relative standards 
as reflected in a description and analysis of the characteristics of alter- 
nate programs. Figure 7 represents the process of judging the merit of 
an educational program. 

Besides recording the judgments made by the program director and his 
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staff while the program is In operation {or while a curriculum plan Is 
being implemented), the professional evaluator must assume the task 
of making final judgments concerning progra m worth . In making final 
judgments, the evaluator must determine whether standards have been 
met, and he must, therefore, specify the standards that he is using for 
making his judgments. 

Judgments made and recorded while a program is in operation and 
final judgments made about a program upon completion may be distin- 
guished as formative and summative evaluation. Stake notes, for example, 
that materials not ready for distribution to classroom teachers represent 
formative evaluation. On the other hand, summative evaluation assumes 
an acceptance of responsibility by the evaluator for informing consumers 
of the merits of these materials. Because of his responsibilities, the 
summative evaluator must learn whether intended antecedents, transactions, 
and outcomes are consistent with the resources, standards, and goals of 
the school under consideration; the formative evaluator is more interested 
in contingencies and the co-variations within the evaluation study and 
across studies as a basis for guiding the development of present and future 
programs. Both of these forms of evaluation are necessary in evaluation 
studies; both should be included in evaluation reports, the former being 
one criterion for the latter. 

Limitations of previous studies. The evaluation studies reviewed 
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above, along with several other studies and reports, represent serious 
and professional attempts to assess special educational programs. The 
detailed studies of Experienced Teacher Fellowship Programs by Crockett, 
et al. , along with the several studies of summer Institutes , have made 
important contributions to the literature on program assessment. There do 
not appear to be, however, any in-depth evaluation studies available 
of a single Experienced Teacher Fellowship Program. 

During the past decade, professional evaluators have devised 
evaluation models that may be used to analyze programs and curricula. 
These models incorporate a variety of techniques for data gathering and 
establish structured procedures that are useful to decision-makers while 
projects are in operation. Further, these models assist the evaluator and 
the educator to gain a better understanding and perspective of a total 
program or curriculum so that judgments of effectiveness and worth may be 
rendered . 

Although these models have been used to assess curriculum projects, 
they have not been used extensively to evaluate special long-term teacher 
programs. Since special teacher programs that have been evaluated via 
the new models have been generally short-term programs, of five to ten 
days in duration, there exist few, if any, studies of long-term educational 
programs for teachers that make use of the newer models or techniques and 
procedures found in these models . 

Finally, in many in-depth evaluation studies of special teacher 
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programs, evaluators represented external agencies. This approach has 
considerable merit, and may be considered by many individuals to be 
the sine qua non of effective evaluation. However, as suggested In 
the Cochrane, et al. report on five Experienced Teacher Fellowship Pro- 
grams, assessment may be enhanced through an analysis of the opinions 
of individuals who were involved in the program. Likewise, there exist 
perhaps few, if any, studies of a long-term educational program for 
experienced teachers that were conducted by individuals with first-hand 
knowledge of the program's transactions on an almost dally basis. 

In conclusion, the evaluation of the ExTFP represents a study that 
( ; combines several features not found in previous studies, representing 

(1) an in-depth study of a single Experienced Teacher Fellowship Program, 

(2) that employed current evaluation techniques based on a structured 
evaluation model, and (3) was conducted by an Individual directly assoc- 
iated with the program from its Inception through its formal termination. 
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CHAPTER III 



PROCEDURES 

In contemplating appropriate procedures to evaluate the ExTFP, the 
three educational evaluation models reviewed above were considered in- 
cluding (1) the EPIC Model, (2) the CIPP Model, and (3) the CIRCE Model. 
Each of the three models was judged to hold potential utility and certain 
attractive features for use in the evaluation of the ExTFP. 

I. THE RESEARCH DESIGN 

Selecting an evaluation model . Tn assessing the three evaluation 
models under consideration, it became necessary to determine which model 
could be most readily adapted for the planned evaluation. The procedures 
included in the CIRCE Model that contained the comprehensive gestalts 
or broad categories for data gathering of antecedents , transactions , and 
outcomes were judged to have the most promise in this respect. Further- 
more, the emphasis of the CIRCE evaluation philosophy recommending 
judgments of program worth based on the Information gathered in the de- 
scriptive and judgment matrices of the model were considered to be an 
important aspect of program evaluation. It was primarily the above two 
features of the CIRCE Model that led to the selection of this model as 
most appropriate for evaluating the ExTFP. 



Similar to the CIRCE Model, the other two models under consideration 
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were Judged to have Lnternal logic and consistency. The EPIC Model, 
however, was judged to hare less potential for adaption because (1) 
the three dimensions identified in the "cube" seemed less appropriate 
to program evaluation than they may be to curriculum evaluation, (2) 
identifying factors based on a three-dimensional variable seemed to be 
a complex procedure, and (3) the model and the accompanying procedures 
place a greater emphasis on stating objectives in behavioral terms and 
the need to measure attainment against these objectives. Regarding 
this latter emphasis, the EPIC Model shows a greater reliance on pro- 
duct evaluation similar to the Tylerian approach of the 1930's. This 
emphasis was judged to be inappropriate and Inadequate for evaluating a 
long-term educational program since it seemed to center around effete 
procedures that were not attuned to current developments in educational 
evaluation. 

The authors of the CIPP Model, Guba and Stufflebeam, encourage 
an assessment of the process of a program and emphasize the need to 
provide decision-makers with accurate information that will offer educators 
the opportunity to make a rational selection from among several alter- 
natives. This dimension of the CIPP Model was considered to be a 
desirable feature. The CIPP Model was not used, however, because the 
procedures were judged to be more complex than those included in the 
CIRCE Model, and subsequently, because it would be more difficult to 
adapt the CIPP Model for large-scale program evaluation. Also, and in 
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contrast to the CIRCE Model, the CIPP Model does not encourage sum- 
mative evaluation, i.e. , a final assessment of program worth end ef- 
fectiveness . In criticizing the procedures proposed by Cuba and 
Stufflebeam, Gene V. Glass, a CIRCE staff member, suggests that 
"being of assistance to the program personnel — -so that they may better 
conduct their business — is a proximate aim of evaluation ; the ultimate 
aim of an evaluation is to decide questions of worth. 11 * The judgment 
that an assessment of program worth must be part of program evaluation, 
coupled with the greater adaptability of the CIRCE Model, led to an accep- 
tance of the procedures for evaluation suggested by the CIRCE faculty. 

Application of the model. The study of the ExTFP was organized 
around the three major gestalts identified in the CIRCE Model, viz., 
antecedents, transactions, and outcomes. The major topics analyzed 
in each of these categories are Identified in Figure 8. 

Using the procedures established in the CIRCE Model, the rationale 
for the program was examined, followed by an analysis of the data con- 
tained in each of the content areas identified in the three major gestalts . 
Within each of the content areas , consideration was given to (1) intents 
and (2) observations. The analysis does not follow a lock-step pattern, 

k3ene V. Glass . The Growth of Evaluation Methodology. (Laboratory 
of Educational Research, University of Colorado, n.d.), p. 36. (mimeo- 
graphed . ) 
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FIGURE 8 

THE ORGANIZATION OF THE ExTFP EVALUATION STUDY 




however. That is, the organisation of the study was not planned around 
the horizontal axis of the CIRCE Model, but rather around the vertical 
axis. Therefore, the study does not include separate categories for 
intents and observations. 

Similarly, the iudgments that were made while the program was in 
operation were analyzed as well as the standards against which these 
iudgments were made. As with the descriptive matrix of the CIRCE Model, 

4 

however, the judgment matrix served as a guide and not as an organ- 
izational pattern. Finally, it may be noted that in some instances, the 
categories were largely ignored, as, for example, the topics discussed 
under curriculum content. This acknowledgment is made to suggest that 
the model served as a guide for gaining a panoramic view of the ExTFP; in 
those instances where the several dimensions of the model did not serve 
a specific function, deviations were made. 

As suggested earlier, the analysis of program content, drawn from 
the descriptive and judgment matrices of the CIRCE Model, allow the 
evaluator to make final judgments about the program; in tact, these final 
judgments may be considered the raison d'etre of evaluation. Figure 9 
suggests this focus and suggests further a major component of this 
evaluation study. 

In this report, Chapter IV consists of the analysis and Interpreta- 
tion of the data and may be viewed in large part as formative evaluation, 
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figure: 9 

THE OBJECTIVE OF EVALUATION 

i.e., an analysis of data including judgments rendered while the program 
was in operation. Chapter V includes a summary of the judgments made 
relative to program worth and effectiveness. The summary was drawn 
from the analysis and information studied under the descriptive and 
judgment matrices of the model and presented in Chapter TV. 
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'Monitoring the program. The primary source of information about 
the program was the observations made during the daily monitoring of the 
program by the administrative staff and especially the associate director 
of the ExTFP. Since the evaluator of the ExTFP served also as the asso- 
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elate director, the study was not completely free of personal bias. On 
the other hand, few evaluators have so intimate a knowledge or as broad 
a perspective of the program or project they are evaluating; their evalu- 
ation reports based on brief on-site visits and their analysis of question- 
naires may (1) be subject to greater misinterpretation and (2) fail to in- 
clude important factors that should be examined. Under the above con- 
ditions, even "total" objectivity may not lead to completely reliable or 
valid reporting . 

The extent of the associate director’s involvement in the ExTFP Is 
suggested by the following Information that reveals that the associate 
t director (1) was co-author with the program director of the original pro- 

posal submitted to the USOE, (2) was the author of the program's plan 
of operation, (3) responded to most letters of inquiry into the program, (4) 
served on the selection committee, (5) was responsible for many and in- 
volved in most administrative decisions, (6) worked as counselor, ad- 
visor, and ombudsman to the Fellows, (7) coordinated program activities, 
and (8) was the associate instructor with the program director for the en 
bloc courses in economic education. 

The value of this intimate association with the program through all 
its phases led to first-hand knowledge of the program's rationale, 
antecedents , transactions , and such outcomes as the institutional effects . 
t Furthermore, the associate director of the ExTFP had immediate access 
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to data about the program that could be analyzed in perspective and 
utilized appropriately. 

An external validity check. Because adequate funds were not pro- 
vided/ it was not possible to conduct the planned in-depth external 
evaluation of the program (see Appendix A). However, having decided 
to employ the procedures for evaluation included in the CIRCE Model, 
the associate director of the ExTFP made the decision to request assis- 
tance from the CIRCE staff for gathering ideas that would be helpful in 
making application of the model in evaluating the ExTFP. 

In response to the request for assistance, a staff member with 
considerable experience and competence in evaluation procedures was 
recommended to help with the evaluation plans. In January, 1970, follow- 
ing preliminary discussions about the program and the planned evalu- 
ation, the associate director spent one day at the University of Illinois 
to discuss specific plans and alternative procedures for collecting and 
reporting data. In May, 1970, an external validity check of the program 
was made by the evaluation specialist from the CIRCE staff who had 
agreed to assist in the planned evaluation of the ExTFP. The observations 
reported through this investigation were incorporated into this study; the 
written report is Included in Appendix B. 

A two-day visit by the external evaluator was made on May 6-7, 1970. 
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During this visit, the program director , associate director, and the 
CIRCE evaluator discussed the various components of the ExTFP exten- 
sively. Additionally, the CIRCE evaluator Interviewed fourteen of the 
twenty-one Fellows, Including three Ph.D. and eleven M.A. Fellows. 

All Lwenty-one Fellows could not be interviewed because of the lack of 
time. 

Each interview was approximately thirty minutes in length; in one 
instance , two Fellows were interviewed together. Although the inter- 
views were scheduled on a voluntary basis, those Fellows who were 
interviewed included male and female, and Ph.D. candidates. All 

twenty-one Fellows were encouraged to register for an Interview; all 
volunteers were scheduled to and met for an Interview . 

Besides the interviews with the Fellows and the extensive discussions 
with the director and associate director of the ExTFP, the external evalua- 
tor also held discussions with a number of other individuals associated 
with the program. Again it was not possible during the brief visit to 
arrange interviews or a discussion period with all faculty members and 
other individuals involved in the program. However, the CIRCE evaluator 
met briefly during a noon luncheon with several individuals including (1) 
the practicum director, (2) the co-directors of the group processing 
experience, (3) the chairman of the Department of Economics, (4) a faculty 
member of the Department of Economics and instructor in the ExTFP, (5) 
the chairman of the Department of Secondary Education, and (6) the dlrec— 
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tor and associate director of the program. Although conflicting schedules 
prevented a lengthy session with the entire group, the external evaluator 
was able through this session to gain a greater understanding of the 
ExTFP by comparing comments made by the faculty with the comments 
made by the Fellows during the interviews conducted prior to the luncheon 
meeting . 



Ill . THE CRITERION MEASURES 

Questionnaires . A number of questionnaires were administered 
throughout the year for purposes of adjusting and assessing the program. 
These questionnaires were considered supplementary to the dally moni- 
toring of the program and therefore do not represent a primary source of 
information. Being of the opinion that individuals should be responsible 
for their comments, the Fellows and others were encouraged to Identify 
themselves on every questionnaire . Almost without exception, everyone 
did Identify himself. 

Early in the program, the Fellows were asked to complete a general 
questionnaire that provided background information on each Individual and 
helped to determine the strengths and weaknesses in the academic prepara- 
tion of individuals and the group generally. 

Early In October the Fellows were asked to respond to a twelve-item 
questionnaire related to the September group processing sessions which 
they had completed. This open-ended questionnaire was prepared by the 
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associate director in consultation with the co-directors of the group 
processing sessions. The Fellows were asked general questions about 
the sessions themselves and several questions pertaining to personal 
characteristics . 

Shortly after the practicum was underway, the Fellows were asked 
to respond to a seven-item, open-ended questionnaire that was intended 
largely to provide the practicum director with information about the 
attitudes of the Fellows toward their team and school assignments. This 
questionnaire was prepared by the associate director in cooperation with 
the practicum director. 

During the week prior to the end of the winter quarter and the con- 
clusion of the two quarters scheduled for the practicum, the Fellows were 
asked to respond to a sixty-item questionnaire which examined many 
phases of the practicum experience. This questionnaire was also pre- 
pared by the associate director and the practicum director. Although the 
associate director commonly administered questionnaires and other testing 
instruments, the progra m director administered this particular instrument. 
Before distributing the copies, the director made a plea with the Fellows 
to respond objectively to the questionnaire and guaranteed them that the 
practicum director would not have access to the responses until all grades 
for both the fall and winter quarters had been recorded. Before that time, 
no grades had been issued. 

To gain another perspective on the practicum experience, the ExTFP 
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associate director and the director of the practicum prepared and sent to 
the cooperative school personnel a twenty-one Item questionnaire that 
contained a number of questions that were Identical or similar to the 
questions put to the Fellows . A variation of these questionnaires was 
completed by the practicum director. At that time the practicum director 
did not have access to any of the completed questionnaires. 

Due to student riots, Ohio University was forced to close on A/r ay 
15, 1970, four weeks prior to the scheduled closing time for the Spring 
Quarter, Although the Fellows did not leave town Immediately, It was 
not possible to administer a planned final questionnaire before the Fellows 
left the campus. However, all twenty-one Fellows returned a lengthy 
fifty-item questionnaire that had been sent to their homes . This question- 
naire was an adaptation of the questionnaires prepared by Walter H. 

Crockett, Joseph C. Bentley, and James D. Laird. The teaching faculty 
that was affiliated with the program and the program director and asso- 
ciate director were asked to complete a twenty-item questionnaire which 
was an adaptation of a faculty questionnaire prepared by Walter H. Crockett, 
et. al. Since the Fellows did not pursue all of their course work en bloc, 
only those faculty members who had five or more Fellows in a class were 
asked to complete the questionnaire . Tt was felt that classes with less 
than five Fellows would not provide a sufficient sampling of the group. 
Despite reminders, one of these questionnaires was not completed or re- 
turned, a failure that was more likely due to negligence than to malevolence. 
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Of those faculty questionnaires that were returned, six were from 



the faculty of the College of Education. Of these six, two returns were 
from faculty members who had been instructors in en bloc courses for all 
twenty-one fellows. One return was from a faculty member who had a 
total of sevLn Fellows In two classes that were electives. One faculty 
member was very familiar with the program generally, but had only five 
Ph.D. Fellows in a class; he was not acquainted with the WA. Fellows. 
Although the instrument was less appropriate for them, the remaining two 
questionnaires were completed by the co-directors of the group process 
experience. The responses made to these six questionnaires were 
identified in the various tables Included in the study as the "Education 
Faculty. " 

Peven questionnaires were returned by faculty members of the 
Department of Economics. Four of these were returned by faculty mem- 
bers who had conducted en bloc courses for the M.A. Fellows only How- 
ever, in all but one Instance, at least two Ph.D. Fellows enrolled in 
these courses. One of the questionnaires was returned by a faculty mem- 
ber who had conducted a mandatory course for the M.A. Fellows, but 
which was an open course. About 75 per cent of the class, however, con- 
sisted of M. A. Fellows. One of the questionnaires was returned by a 
faculty member whose class was an elective but yet drew ten A T .A. Fellows 
in a class with a total enrollment of twelve. Finally, a questionnaire 
was returned by a faculty member whose elective course drew five V.A. 
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Fellows and one Ph.D. Fellow in a class of twenty that consisted of 
undergraduate seniors and graduate students . 

The responses to one of the above seven questionnaires, along with 
several comments explaining the reasons for the various choices, were 
dictated to the associate director of the ExTFP. The group of seven 
returned questionnaires is sometimes identified in the various tables 
as the "Economics Faculty.” 

The program director, associate director, and the director of the 
practLcum are faculty members in the Department of Economic Education. 
Each of these members of the Department completed a faculty question- 
naire. These responses are sometimes identified as the "Economic Edu- 
cation Faculty." 

As a caveat emptor, it is Important to understand who completed 
the faculty questionnaires and the different circumstances that prevailed 
in the various classrooms. These differences were reflected in the returns. 

Standardized tests . Instruments to measure cognitive changes that 
were administered to the Fellows Included (1) the Test of Underst anding 
of College Economics (TUCE), prepared by the Joint Council on Economic 
Education in cooperation with the Psychological Corporation of America, 
and r 21 the Test of Basic Economics prepared by E. 3. Wallace, director, 
Nebraska Council on Economic Education, instruments to measure attitude 
changes included 'IV the Survey of Opinions on Economic Issues developed 
by George Dawson, director, New York University Center for Economic 
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Frtunntlnn. and (21 an Inventory of Economic Opinions prepared by Roman 
F. Warmke, director, Ohio Council on Economic Education. Each of 
these Instruments was administered on a pretest-posttest basis. 

The TUCE, copyright, 1968, consists of four separate tests includ- 
ing Form I, Parts A and B, and Form II, Parts A and B Each of the four 
forms of the test contains thirty-three multiple choice items with four 
options given for each ite'n. 

The Items In the TUCE center primarily around "basic economic 
questions." 2 Part I covers macroeconomics concepts; Part II covers micro- 
economics concepts. Although Parts A and B in each form represent 
equivalent tests, all forms and parts of each test were administered as a 
pretest and a posttest. This procedure was followed because U) the relia- 
bility of Part II has not been firmly established, (2) the use of all forms 
of the test provided additional data for analysis and therefore helped to 
establish greater validity and (3) the time that elapsed between the 
administration of the pretest and the posttest was iudged to cancel any 
retention factor. 

The Test of Basic Economics consists of seventy-five questions or 
Incomplete statements that may be answered by selecting the best choice 
from among four alternatives that are given. There is no equivalent form 


o 


2 The Committee for a College-Level Test of Economic Understandings 
of the Tolnt Council on Economic Education. Manual: Test ^Understands 
ing in College Economics. (New York: Psychological Corporation, 1968), 
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to the Test of Basic Economics and therefore the one form was used for 
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both the pretest and the posttest. 

The following paradigm indicates the testing procedures used for 
both the TUCE and the Test of Basic Economics : 

0 t x 0 2 

To analyze the pretest- posttest scores obtained on the TUCE and 
the pretest-posttest scores obtained on the Test of Basic Economics , a 
t_test was employed to test the significance of the difference between 
means for dependent samples. The formula used for this analysis follows: 

t= D 

N» r N ..D 2 - (;d)2] /N-l 

The four forms of the TUCE and the Test of Basic Economics were 
analyzed separately; in the analysis, each pretest was paired with the 
identical test used as a posttest. In each Instance, the null hypothesis 
was formulated, l.e. , that there was no difference between the mean 
score obtained by the pretest population and the mean score obtained by 
the posttest population. This formulation may be written as follows: 

Ho: «: = 0 

j 

The alternative hypothesis formulated in the analysis was that there 
was a difference between the mean score obtained by the pretest popula- 
tion and the mean score obtained by the posttest population. This formu- 
lation may be written as follows: 

HI: oj ->2 7 * 0 
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The level of significance In testing was established at .05. Since 
It was expected that the difference between means would indicate an 
increase in the scores of the posttest population, a one-talled test was 
applied. The degrees of freedom were equal to N-l or 20. 

'I nee six of the seven Ph.D Fellows held advanced degrees In 
economics prior to participation in the ExTFP, many of them concentrated 
their work in the education component of the program. Because of this 
situation, it was thought that perhaps there would be some regression 
in the test scores for the Ph.D. Fellows. To analyze this possibility, 
the test scores obtained on the Test of Basic Economics were analyzed 
(1) in total, and ( 2 ) separately for the M.A. and the Ph.D. Fellows. 

The single form of the iurvey of Opinions on Economic Issues was 
administered to the Fellows as a pretest and a posttest. The test con- 
sists of thirty-five items to which respondents may mark (1) strongly 
agree (SA), (2) agree (A), f3) undecided (U), (4) disagree (D), and (5) 
strongly disagree 03D) . The major purpose in administering this test was 
to determine any major shifts in attitudes toward economic concepts and 
policies . The test is of recent origin and has not been used extensively 
to date; no statistic?! applications have been made of the responses at 
this time. However, the test was analyzed (1) to Identify shifts in 
attitudes from the pretest to the posttest, (2) to determine the nature of 
any shifts and why they were made, and (3) to examine extreme opinions 
and identify any changes between the pretest and the posttest. 
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The Inventory of Economic Opinion consists of seventeen items to 
which respondents may agree or disagree. As with the attitude test pre- 
pared by Dawson, this test was given on a pretest-posttest basis for 
the purpose of determining any significant shifts in attitudes that the 
Fellows might have over the year. To analyze the test results, a sign 
test was employed, i.e., a test that uses plus and minus signs rather 
than quantitative measures as its data. The null hypothesis was 
formulated for each item where: 

p (X A ^>X B ) = OC A OC B > — ^ 

where X A represented the posttest score 
where X B represented the pretest score. 

Under the formula, the probability that the number of agree responses 
on an individual item on the pretest will be greater than the number of 
agree responses on the posttest is equal to the probability that the 
number of agree responses on an individual item on the posttest will 
be greater than the number of agree responses on the pretest. Stated dif- 
ferently, the null hypothesis was formulated that the median difference 
on individual items from the pretest to the posttest would be zero. 

The alternative hypothesis formulated was that- 

P(X A >X B ) / (X A < X B ) / 1/2 

Using a correction for continuity factor of -0.5, the following 
formula was used to analyze the data: 

? = f* 5) - 1/2 N 

1/2 4S r 
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Using a Table of Probabilities Associated with Values as S nail 
as Observed Values of x in the Binomial Test, that provides probabil- 
ities under Ho for the binomial test when P = Q = 1/2, the data were 
examined to determine any significant shifts between the pretest and 
the posttest. 
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CHAPTER TV 



THE ANALYST” AND INTERPRETATION OF DATA 

In November, 1964, Congress authorized an amendment to the 
National Defense Education Act that brought Into existence the Title XI 
institute programs in the humanities and social sciences to be adminis- 
tered through the USOE. Title XI, authorized some seven years after 
Sputnik, was designed to improve the qualifications of elementary and 
secondary teachers In most major subject areas, except mathematics 
and science. The major focus of the proposed programs was placed on 
subject-matter content coupled with ways of using that content in class- 
room situations . 

Authorization for the academic and full-year Experienced Teacher 
Fellowship Programs for elementary and secondary teachers was authorized 
under Title V, Part C of the Higher Education Act of 1965; the programs were 
initiated In 1966. The Experienced Teacher Fellowship Program was subse- 
quently Incorporated Into the more comprehensive Education Professions 
Development Act, authorized by Public Law 90-35 and effective July 1, 1968. 

I . PROGRAM RATIONALE 

USOE objectives . To improve the quality of education in the nation's 
elementary and secondary schools, Experienced Teacher Fellowship Programs 
we re supported to (1) provide full-time graduate education and specially 
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planned courses of studies for experienced teachers and < 2 ) create an 
Increased concern for the training of teachers in colleges and univer- 
sities throughout the nation. Whereas In some of the earlier programs 
efforts were made to attract and select potentially influential teachers 
to oartlcipate in the programs, by 1969 there were greater efforts put 
forth to attract experienced teachers teaching in schools located in 
urban ghetto areas and rural poverty regions . 

Although the conception of the Experienced Teacher Fellowship 
Program generally was broad and inclusive, covering a wide range of 
subject-matter, the directors of funded programs were encouraged to 
^l) create better cooperation between subject-matter and teacher-edu- 
cation specialists, 12 ) design specific courses for a rather homogeneous 
group of students, and (3) encourage better cooperation between insti- 
tutions of higher education and local school districts and systems. 

'n promoting greater cooperation between subject- matter and 
teacher-education specialists, the USOE administration began to en- 
courage the institutionalization of special programs for teachers. As 
an ultimate goal, the USOE administration hoped to create a new cadre 
of college professors who would have an Impact on the nature of teacher 
education, and beyond, the nature of the university itself. Donald N, 
Bigelow, Director, Division of College Programs, and then Director of 
the Division of Educational Personnel Training, speaking before the 
nineteenth annual conference on teacher education of the Texas Educa- 
tion Agency, October, 1966, spoke of teacher education as "that separate 
and distinct part of the academic world which is most directly and tmmed- 
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V iately concerned with the production and training of teachers and 

proclaims its mission as such ." He referred to the non-teacher education 

part as " the establishment, since, invariably, this Is the term applied to 

the high church of any society and It neatly describes the university . 

Bigelow went on to identify teacher education as a "ghetto" 

and the establishment as a "landlord" and suggested that 

While it might appear that the establishment, the non-teacher 
education part (or the high church) has assumed exclusive 
rights to those subjects which are thought of as 'substantive, ’ 
which usually fall within the liberal arts curriculum, there 
never has been any particular logic which proclaims just what 
is meant by 'high quality substantive courses. 

Of the belief that "segregation, as in the past, of the education- 
ists and the liberal arts teacher is no longer meaningful," Bigelow 

o 

expressed a belief in the "beginning of a synthesis," a move toward 
the "twin goals of teaching and learning," and a realization on the 
part of many professional educators that "content and method are in- 
deed Indivisible „ 

Tn supporting Experienced Teacher Fellowship Programs the USOE 
adminis tration insisted that the college courses should be especially 
designed for school teachers and that they should be distinctive. The USOE 

x 

Donald N. Bigelow. On the Rediscovery of Teacher Education . 
(Washington, D. G. : U.S. Department of Health, Education and Wel- 
fare, 1967), p. 5. (mimeograph.) 

2 Ibid. 

3 Ibid . , pp. 7-8. 
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administration recognized that classroom teachers had particular needs 
and that even a well-taught course directed toward students with different 
interests and vocational concerns did not necessarily provide useful instruc- 
tion for the classroom teacher. Therefore, the USOE encouraged an en 
bloc_ procedure where courses could be tailor- made for a homogeneous 
group of students of defined background and preparation . It was hoped 
under this procedure that professors would direct their attention specifically 
to the needs of the classroom teacher and that they would not assume 
that the teacher would or could by himself transfer knowledge into Imagin- 
ative curriculum, lesson plans, and classroom procedures. 

Q Critical of regular graduate school programs that left the individual 

classroom teacher to the mercy of the "catalog's cefeterla-like offerings, 
the USOE administration hoped through the en bloc organization to provide 
greater visibility of the program on the campus and a greater opportunity 
for program participants to profit from interaction with their peers and the 
formal instruction of their professors . It was hoped ultimately that "estab- 
lishment" professors would take advantage of the special opportunity offered 
through en bloc programming to give serious thought to the teaching and 
learning process rather than assume that someone else, presumably from 
the college of education, would address himself to the problem. Speaking 
on this need, Robert D. Cross, President, Hunter College, in an address 
^ delivered to the third annual meeting of Directors of NDEA Institutes for 

Advanced Studies in Washington, D. C. , November 1966, commented on 
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a "brilliant lecture" by an "extremely competent historian" who spoke of 
changing interpretations on the coming of the Civil War. An Institute par- 
ticipant asked at the conclusion of the lecture what might be the implica- 
tions of this lecture for the way one taught a unit on the Civil War in the 
schools . "The lecturer, an honest man, replied that he had never been 
able to figure that out in giving his college class either. " 4 One of the 
major intents of the new legislation was to encourage "brilliant pro- 
fessors , such as the competent and honest historian, to address them- 
selves to the important needs in elementary and secondary education . 

A final recommendation and hope of the USOE administration in re- 
gards to the Experienced Teacher Fellowship Programs, as well as sum- 
mer institutes, was to encourage greater cooperation between institutions 
of higher learning and local school districts and systems . To encourage 
greater cooperation, the UPOE administration recommended that program 
participants be selected by their home educational system and that the 
local system guarantee the applicant a position upon completion of the 
program. Furthermore, the USOE administration encouraged program direc- 
tors to conduct practlcum experiences in which the participants would be 
given an opportunity to use content and experimental designs in actual 
classroom situations in local school districts. These opportunities were to 
be provided by the local school districts in a cooperative effort Giro uraged 

4 RobertD. Cross. The Testimony of a Repentent Backslider . (Wash- 
ington, D.C.: U.S. Department of Health, Education, and Welfare, De- 
cember, 1967), p. 6. (mimeograph.) 
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by the universities . The USOE bulletins and handbooks did not specify how 
the practicum experience should be conducted, but did strongly encourage 
some type of practicum experience. 

In summary, the USOE administration wished to promote innovative 
teacher education programs proposed and conducted by institutions of 
higher education. The primary Intent in granting support to special pro- 
grams was to provide a stimulant to curriculum and institutional change; 
the support was not granted to perpetuate an Ineffective and outmoded 
educational system. Donald Bigelow stated the case in introducing the 
then new Education Professions Development Act when he declared that 

While its purpose is to increase the quality and quantity of 
all types of educational personnel, its immediate focus is 
unmistakable: to continue the efforts made over the last ten 
years to foster maximum interaction among educational in- 
stitutions and community agencies in order to bring about 
institutional change to improve the production of teachers — 
the number one priority in American education.^ 

Over a period of several years, the U^OE administration consistently 

maintained that curriculum and institutional changes in education were 

the-pr-Unary goals-ln-granting program support— . 

The ExTFP Objectives. Reflecting the general guidelines and emphasis 
of the USOE administration, the proposal submitted to the U80E requesting 


C ) 


^A Handbook for Directors: Education Professions Development Act, 
Programs 1969-70. (Washington, D. C.: U. 8. Department of Health, 
Education and Welfare, 1968), p. viii. 
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support for the ExTF? Identified four major objectives. The first of these 
objectives was a request for the support of five post-M.A. participants 
who would be trained for leadership roles in teacher education including 
executive positions with fl) councils and centers on economic education 
and (2) innovative projects in curriculum development and instructional 
techniques . It was hoped through this objective to prepare a national 
cadre of leaders In economic education specifically and teacher education 
generally who could in time be placed in pivotal positions where they 
would directly or indirectly affect elementary and secondary education. 

The second broad objective called for the support of twenty-five 
elementary and secondary toachers, especially those teaching In poverty 
areas. The broad objective to be achieved In having these teachers parti- 
cipate in the program was to provide elementary and secondary school 
systems with specialists In economic education prepared to Implement im- 
aginitive and effective programs of Instruction, research, curriculum 
development, and community service. 

The 'th ird objective was - to expand upon liaison efforts for program 
enrichment between Ohio University and local school systems In coopera- 
tion with the Ohio Council on Economic Education, state departments of 
education, and professional agencies and associations. It was hoped 
through this objective to strengthen an "external image" that would en- 
courage the expansion of economic education activities on other college 



and university campuses. 
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The fourth broad objective was to develop through the ExTF 15 an 
"internal image" that would foster similar university-school cooperation 
and emulation among other departments and divisions of the university. 
That Is, it was proposed that the ExTFP would help to institutionalize 
economic education at Ohio University as well as promote teacher edu- 
cation programs at Ohio University generally by creating a greater con- 
cern and interest for the teaching process as it applies to elementary 
and secondary education. 

The broad objectives, it was suggested in the proposal, would be 
achieved through more specific objectives and methods , structured to 
provide teachers of common educational backgrounds and academic 
interests (1) a rigorous and systematic program of study, (2) a substitlve 
background in economics with special emphasis on the analytical methods 
of the economist as a social scientist, (3) assistance in translating 
economics and scientific methods of Inquiry into viable curricula suited 
to elementary and secondary social science courses, and (4) with a know- 
ledge of the new and challenging materials developed through curriculum 
research and development projects The means for reaching these objec- 
tives, both the broad and the specific goals, were developed in the 
remainder of the program proposal. 
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II, ANTECEDENTS 

Program context. Ohio University, the host institution for the 
ExTFP, is a state educational institution located in Athens, Ohio, and 
in the non- Industrialized, Appalachian portion of the state. Founded in 
1804, Ohio University is the oldest public institution of higher education 
located in the Old Northwest Territory. At the turn of the century, the coal 
mining Industry made this section of the country an active and thriving 
region. Today, with the coal mining Industry defunct, small towns with 
declining populations dot the picturesque landscape of this area on the 

western slopes o f the Allegheny foothills • 

During the 1969-70 academic year, Ohio University's enrollment on 
the Athens campus was around 17,800 graduate and undergraduate students. 
Undergraduate students could pursue degree programs selected from 100 
study areas; graduate studies Included 44 naster's programs and 15 doc- 
toral areas. The university maintained additional educational programs 
offered through the five branch campuses located in the southeastern 
section of Ohio. 

Through special teacher programs and curriculum projects, Ohio 
University has distinguished Itself in the area of economic education. 
Since the first and subsequent annual summer institute in economic educa- 
tion in 1952, and the founding of the Ohio Council on Economic Education 
(OCEE) in 1953, Ohio University has provided a systematic program of In- 
struction, research, and service to elementary and secondary teachers and 
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school systems in economic education. The extent of involvement in spe- 
cial economic education programs is suggested by the information which 
reveals that (11 750 teachers participated in OGEE sponsored or co-spon- 
sored in-service programs in economic education during the year 1969-70, 
(2) the ExTFP was the sefcond Experienced Teacher Fellowship Program 
conducted at Ohio University, (3) besides the OCEE, a Department of 
Economic Education has been established in the College of Business Ad- 
ministration in 1967, (4) the Department conducted a Special Clinic for 
NUEA and NSF economic institute directors in 1968, (5) Ohio University 
offers an T *.A. in Economic Education and a Ph.D. in Secondary Edu- 
cation with a Concentration in Economic Education, (6) a national deposi- 
ts ) 

tory for the award winning Kazanjian Foundation materials in economic ed- 
ucation is located at Ohio University, (7) the staff of the OCEE in coop- 
eration with Ohio's State Department of Education produced a special 
economic education series of TV films in 1969-70, (8) the National Science 
Foundation (NSF) supported a cooperative school program in economic 

- education in 1969-70. a nd 1970-71, and (9) N SF h as granted support for 

an in-service institute in economic education, 1970-71. 

The initial Impetus for special programs in economic education at 
Ohio University began in 1953 when Tohn C. Baker, then President of Ohio 
University, and a group of faculty members, founded the Ohio Council on 
Economic Education. The OCEE was established as a non-profit educa- 
tional organization whose major purpose was to encourage, coordinate, 
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and service "economic understanding through objective study." Since the 
first summer workshop in 1952 and the founding of the OCEE in 1953, the 
Council has Increased its services and staff and expanded its budget. 
Besides in-service courses for teachers, summer institutes, and extensive 
materials distribution, the Council sponsors special and intensive programs 
in select school districts including Developmental Economic Education Pro- 
grams (DEEP) and Systematic Economic Education Development (SEED). 

The Council works in cooperation with other institutions of higher 
education, elementary and secondary schools, and Ohio's State Department 
of Education. Support for the many services and programs is received 
from leaders who represent several sectors of the economy in Ohio includ- 
ing business, labor, Industry, and agriculture; OCEE board members in- 
clude executive officers from all of the above areas. 

Besides the materials distributed to elementary and secondary schools, 
the OCEE maintains two materials centers. One of these is the depository 
for the award-winning materials in economic education supported through 
the Kazanj ian Foundation. These materials are located in a separate room 
in Ohio University's Vernon R. Alden Library. The second center for mate- 
rials is the Curriculum Materials Laboratory that contains 1,000 volumes in 
addition to a collection of economic education curriculum guides, courses 
of study, research reports, periodicals, newspapers, and related materials. 
The Curriculum Materials Laboratory is located in a room adjacent to the 
offices of the Council and Department staff. 
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The establishment of the Department of Economic Education at 
Ohio University was a direct outgrowth of the OCEE educational activities 
and was Initially established to work with special academic programs not 
supported through the private sector of the economy. The Department, 
located along with the OCEE In the College of Business Administration, 

Is a fully accredited and recognized academic unit concerned primarily 
with teacher education and the translation of economic content Into 
curriculum appropriate to elementary and secondary students. Through 
cooperation with other departments, especially the Department of Econo- 
mics and the Department of Secondary Education, the Department of 
/ , Economic Education maintains an Inter-colleglate, Inter-departmental, 

and Inter-dlsclpllnary approach In teacher education and curriculum 
develop ment with an emphasis upon economic education. 

To date, courses offered by the Department of Economic Education 
have been almost exclusively for experienced teachers with credit avail- 
able at both the undergraduate and the graduate levels. The Department 
ad ministers the M.ATln h'cono mio^Edacatlorrand'worksln-cooperatlon with 
the Department of ’’econdary Education which offers the Ph.D. In Secondary 
Education with a Concentration In Economic Education. As part of the 
Institutionalization process, courses In economic education will be 
offered for pre-service teachers at the undergraduate level commencing 
, In the Fall Quarter, 1970. 

C.) 

Despite the evidence of overall University support, that Included 
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the establishment of (1) the OCEE as a service component of the Uni- 



versity and W the Department as a viable academic unit in the College, 
there were evident during the year of the ExTFP some obstacles to suc- 
cessful Institutionalization at the College level. Primarily, the problems 
revolved around the manner of financing special programs in economic 
education and the unique nature of these programs. In contrast to the 
usual direction of the rest of the College, the programs and courses in 
economic education were directed toward experienced teachers and at the 
graduate level only; they were financed through special grants, as, for 
example, the USOE grant that supported the ExTFP. These potential sources 
of conflict were compounded by the fact that the year of the ExTFP was a 
transitional year In the Colleger While the Dean of the College was 
completing a five-year term of office, the College faculty, In cooperation 
with the Vice President and Dean of Academic Affairs, appointed a Dean 
Search Committee. The Director of the ExTFP served as a member of this 
committee . 

The terms of the^rantloF the^ExTFPn.'ncTO to each 

participating Fellow of $4,800 for the full-year and $720 for each depend- 
ent. Additionally, the University was granted support of $3,100 for 
each participant for the full-year to conduct the program according to 
the terms of the proposal. The University-support funds from the USOE 
were placed into the general budget of the University. It became then 
the responsibility of the Department Chairman to negotiate a line-item 
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budget with University officials to conduct the program In accordance 
with the terms of the proposal that the USOE administration had agreed 
to support. 

In the negotiations with the University administration, the Depart- 
ment was granted a line-item budget that was consistent with the terms 
of the proposal. This budget was approved by the University President, 
the Provost, who was In charge of academic affairs, and the Dean of the 
Graduate College. At the College level, however, problems arose after 
the budget had received approval by Central Administration. For Instance, 
the line- Item budget negotiated with the central University officials In- 
cluded funds for travel and guest speakers that were In excess of all 
other departments In the College combined. 'The College is, however, 
a relatively small College and does not offer any doctoral programs.) In 
this Instance, the funds granted to the Department for travel and for guest 
speakers had been Included in order to meet the terms of the proposal 
agreement with the USOE, Based on the amount of support In certain 
areas, the College administrators referred to the Department as a "fat 
cat" department. Further, there were several successful attempts made to 
confiscate Department funds despite the fact that the program enjoyed 
the support and respect of the University's central administration. (At 
Ohio University, once a departmental budget has been approved at the 
central administrative level, future negotiations rest almost entirely be- 
tween the department chairman and his respective dean.) Thus, constant 
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budget surveillance within the College became necessary to fulfill the 
legal requirements and the spirit of the grant. 

Tt should be noted, however, that any problems that occurred at 
the College level were not unique In higher education; the "high church" 
was everywhere alarmed over proposed changes. For Instance, at the 
meeting of program directors held In Washington, D. C., February 6-7, 

1969, in a sectional meeting conducted by Donald N. Bigelow, the pro- 
gram directors present Inveighed against the administrative officers from 
the Institutions they represented for confiscating funds provided by the 
USOE In support of the programs to be conducted at these institutions. Not 
uncommonly, administrative officers made large charges for tuition against 
the program grant, levied extra charges for en bloc courses, and at the 
same time received state assistance for the courses on a full-time equiv- 
alent basis. This procedure resulted In a situation where, in some Instance^ 
less than half of the funds generated by the program were used In its 
support. According to the program directors present, It was difficult to 
conduct the programs Initially proposed because ft) the USOE administra- 
tion often failed to support those portions of the proposed programs that 
represented a departure from conventional programming (often the very 
items that had led to the high rating of the proposal by the proposal 
readers) and (2) the host Institutions often charged and sometimes double 
charged against the grant's budget for any services provided. The plea 
of many program directors present at the February meeting was for USOE 
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administrative support in conducting funded programs and for ideas in 
arranging progra m budgets that would lead to greater protection of grant 
mone y . 

Since the host institution had experienced rapid student growth 
during the decade of the 1960's, there was a shortage of classroom and 
office space throughout the University. Neither the OGEE nor the Depart- 
ment of Economic Education were granted adequate facilities to conduct 
the volume of business prompted by special teacher education progra ms 
and projects. Although the USOE administration encouraged and expected 
that facilities for special programs would be adequate, the Department 
could not provide a suitable or attractively furnished study area that could 
accommodate groups of students in excess of ten. 

Because of the lack of space, the facilities for economic education 
were divided between two buildings. The main facilities were located in 
the basement of a building that had at one time served as the University 
gymnasium. These limited quarters, lacking even a fenestella, contained 
the offices of the director and associate director, a staff member of the 
OCEE, the Department and OCEE secretarial staff, and the Curriculum 
Materials Laboratory. Despite requests to be moved from the ‘'temporary" 
quarters into more adequate and suitable facilities, no changes were made 
during the year. 

Because of the shared Interest in teacher education, the Department 
of Economic Education in large part achieved Its goal of an inter-collegiate 
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and inter-depart mental approach. The extent of achievement Is suggested 
by the cooperative and cordial relationship that existed between the 
Department of Economic Education, located In the College of Business 
Administration, and the Department of Secondary Education, located in 
the College of Education. The inter-colleglate approach did not, however, 
extend beyond these two colleges. Additionally, an Inter-departmental 
approach to teacher education programs in economic education existed 
within the College of Business Administration. Candidates for the V.A. 

In Economic Education took many of their courses In economics, courses 
which were offered through the Department of Economics. Although this 
Inter-departmental approach was generally satisfactory, there were Isolated 
Instances of dissatisfaction that may have been triggered by the potential 
competition between the two departments. 

Except for the relationship that existed between the disciplines of 
economics and education, the goal of an inter-disciplinary approach in 
teacher education was not achieved in any meaningful way. Although the 

ExTFPwas "in Economic Education and Related Social Sciences , " only 

limited references were made to the relationship of economics with the 
other social sciences during the year. The Fellows in the ExTFP were 
encouraged to pursue course work In other social sciences for their electives 
however, many Fellows selected courses In economics and education. 
Furthermore, only limited communications v/ere established between the 
Department of Economic Education and such departments as political 
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aclence, sociology, geography, or history. 

Tn an effort to assess the program context, the teaching faculty 
was asked to respond to several questions relative to this area. Table T 
gives an indication of the faculty's opinions of the attitude of the host 
institution toward the ExTFP. 

TABLE I 

THE FACULTY'S OPINIONS OF THE ATTITUDE OF THE 
HOST INSTITUTION TOWARD THE ExTFP 





What was the attitude of 
your institulon toward 
the Experienced Teacher 
Fellowship Program? 


Education 

Faculty 


Economics 

Faculty 


Econ.Educ. Total 

Faculty 



Strong Interest and support. . 


2 


1 


0 


3 


Cooperative 


1 


5 


3 


9 


Toletated it 


0 


1 


0 


1 


Lack of interest and support . 


0 


0 


0 


0 


No acquaintance with it . . . 


1 


0 


0 


1 


No response 


2 


0 


0 


2 



The responses to the question posed in Table 1 should not be con- 
strued to mean that the individuals who were not of the opinion that there 
was stong Interest and support toward the ExTFP were themselves not 
Interested or supportive. Rather, the data included in the table should 
be interpreted to mean that a maiority of the individuals responding to the 
question were of the opinion that there was not evidence of overall strong 
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interest and support. 

A related question was put to the teaching faculty to learn their 
perception of the fit of the Fellows to the type and objectives of the host 
institution. As the responses to the question posed in Table II suggest, 
several of the teaching faculty found exceptions . 

TABLE II 

THE FACULTY'S OPINIONS OF THE FIT OF THE FELLOWS WITH 
THE TYPE AND OBJECTIVES OF THE HOST INSTITUTION 



How closely do you feel the 
participants selected for your 
Experienced Teacher Fellow- 
ship Program fit in with the 
type and objectives of your 
institution? 


Education 

Faculty 


Economics 

Faculty 


Econ .Educ . 
Faculty 


Total 


Very closely 


3 


1 


2 


6 


A few exceptions 


3 


3 


l 


7 


A number of exceptions. . . . 


0 


2 


0 


2 


Hardly fit at all 


0 


0 


0 


0 


No response 


0 


1 


0 


1 



In interpreting the data in Table II, there remains some question 
as to what the teaching facultypercelved the type and objectives of the 
institution to be and what they thought ideally they should be. Those mem- 
bers of the teaching faculty who observed this distinction may have re- 
sponded differently if this distinction had been made clear. Nonetheless, 
the teaching faculty that worked with the ExTFP was generally of the 
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opinion that there was a goodness of fit or a few exceptions between the 
institution and the Fellows who participated in the ExTFP. 

In analyzing the program context, the external evaluator found 
indications of a "lack of integration among the various components" of 
the program, an observation based on the Interviews with the Fellows. 
The Fellows were consistent in their opinions as suggested by their 
responses to the question in Table III. 

TABLE III 

THE FELLOWS' ASSESSMENT OF PROGRAM COORDINATION 



The program Involved instruction in 
more than one academic department. 
How well was the material in one 
department coordinated to that in 
another ? 


Ph.D. 


M.A. 


Total 


They fitted together very well . . . 


2 


0 


2 


They fitted together quite well . . . 


5 


11 


16 


They didn't fit together at all well. . 


0 


2 


2 


No response 


0 


1 


1 



Based on the assessment of the external evaluator, some of the reasons 
for the opinions of the Fellows was based on the "lack of in-depth know- 
ledge concerning economics" and of being "rushed through the summer intro- 
ductory course." Since this assessment is perhaps essentially correct, 
even more careful plans will need to be made to make program participants 
and the teaching faculty more familiar with the program context early in the 
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Curriculum content. As recommended by the USOE administration, 
the ExTFP led to an advanced degree. Fellows in the M.A. portion of the 
program followed a schedule whereby they could obtain the * A . in Eco- 

no mic Education during the one year of the program. The post-M A. 

Fellows were not expected to complete all of the requirements for the 
Ph.D. in Secondary Education, but did pursue a program plan that enabled 
them to complete the major portion of course work during the year. 

The A*. A. program was organized specifically for experienced tea- 
chers with a baccalaureate degree and a standard teaching certificate; app- 
licants for the degree were expected to nee t the normal admission require- 
ments for the Graduate College of Ohio University. Because of the planned 
practicum, the Fellows were required to take more than the minimum 48 
quarter hours of credit in economics, education, a^d economic education. 
However, due to the special nature of the ExTFP, prerequisites in economics 
were not required for admission. En bloc programing, as recommended by 
the USOE administration, was arranged for the required courses with the 
exception of three economics courses that had open enrollment. An out- 
line of the *' T .A. curriculum for the ExTFP as it appeared in the program 
brochure has been reproduced on page 97. 

Perhaps the only adjustment of any consequences in the program out- 
line was the change of the Master’s Seminar, scheduled during the Spring 
Quarter, from three credits to one credit. Since formal class sessions in 
economic education were not scheduled during the Spring Quarter, this 
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PROGRAM CONTENT AND ORGANIZATION 



Course Description Quarter Credits 

Summer Quarter 

Monetary D olicy 3 

Economics in the Curriculum 3 

Economic Education Programs 3 

Adv. Principles of Teaching 3 

Inter-Quarter 
Special Non-Credit Group Process Experience 

Fall Quarter 

EdR" 521 
Econ 515 
EcEd 650 
EcEd 6S0 



Econ 503 
Econ 575 
EcEd 651 
EcEd 690 



Econ 504 
Econ 576 
EcEd 691 
Econ 

*T n general, participants In the program will be encouraged to 
select from among the following courses* 



Educational Statistics j 

Economic History of the United States 
Economic Education Research 
Studies in Economic Education: 
Practicum 



Winter Quarter 

Advanced A^lcro— economic Theory 
Economics of Poverty 
Economic Education Seminar 
Studies in Economic Education: 
Practicum 



Spring Quarter 

Advanced ’Aacro-economic Theory 
Economics of Human Resources 
''’aster's Seminar: Colloquium Papipr 
Elective in Economics'’ 



4 

4 

3 



4 

4 

3 



4 

4 

3 

4 



Course Title 



Fin 551 
EcEd 546 
EcEd 549 
EdSe 555 



Econ 505 
Econ 525 
Econ 528 
Econ 535 
Econ 563 
Fin 655 



History of Economic Thought 4 

Comparative Economic Systems 4 

Regional Analysis 4 

Introduction to Econometrics 5 

Economics of Government 4 

Seminar in Vonetary Theory 4 
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adjustment allowed the V,A. Fellows to complete their colloquium papers 
independently and take an elective In any subject-matter area they wished. 

The * '.A. In Economic Education, which was approved by the Ohio 
Board of Regents in May, 1968, consists of two major components including 
(!) a minimum of twelve quarter credits In economic education courses and 
(2) a minimum of twenty-seven quarter credits in economic courses. 
Remaining courses to complete the necessary total of forty-eight credits 
for the degree may be selected by the degree candidate In consultation 
with his advisor; choices for electives are based on the Individual cand- 
idate's background and interest. The program schedule for the m.a. in 
Economic Education Is included In Appendix T of this study. 

The courses In economic education included In the degree program 
were Introduced Into the Ohio University curriculum in 1967 to assist the 
experienced teacher in the Experienced Teacher Fellowship Program, 1967— 
68, In making direct translation of economic content into curricula suit- 
able for elementary and secondary students. The sequence of economic 
education courses scheduled en bloc for all twenty-one Fellows was in- 
cluded In the ExTFP for the purpose of providing a means for the Fellows to 
snythesize a number of experiences Including Q) past educational and 
professional experiences, (2) formal course work in economics, (3) formal 
course work in education, and (4) the scheduled practlcum experiences. 

This synthesis was planned around the Master's colloquiu m paper 
which was required In lieu of a Master's Thesis. The colloquium paper was 
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to consist of teaching units Intended for specific courses that the 
Fellows expected to teach upon completion of the program. Further, an 
original copy of each completed paper was to be bound and left on file 
In the OCEE’s Curriculum Materials laboratory. Since the Ph.D, Fellows 
all held advanced degrees, and further, were not necessarily expected 
to return to elementary or secondary teaching positions, they were not 
required to complete a Master's colloquium paper; instead, they were 
required to complete a scholarly paper on a subject in or related to eco- 
nomic education. 

The economics portion of the M.A. program consisted of basic eco- 
nomics courses and was included In the ExTFP to provide a foundation in 
economics that was considered essential to understanding basic theory 
and identifying major concepts, ideas, and the frame of reference of the 
professional economist. Since it was anticipated that many of the M.A. 
Fellows would not have an adequate background in formal economics in- 
struction upon entry into the program, two introductory courses were in- 
cluded in the summer schedule. The courses in the economics of poverty 
and the economics of human resources were Included In the schedule be- 
cause the M.A. portion of the program was directed toward experienced 
teachers employed in urban ghettoes and rural poverty regions . 

A basic en bloc course in education was included in the summer 
schedule for all twenty-one Fellows to make the Fellows familiar with 
contemporary learning theories, the taxonomies of educational objectives, 
and recent developments and Issues in elementary and secondary education. 
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The Introductory educational statistics course was included in the schedule 
in lieu of an econo metrics course and was scheduled en bloc for all 
twenty-one Fellows. The major purpose of this course was to 'nake the 
Fellows (1) familiar with basic statistical concepts that would be used 
in the scheduled advanced economics courses, and (2) more knowledge- 
able of research techniques and better able to understand professional 
research studies in education and economics. 

T ndivlduals interested in making application for the Ph.D. portion 
of the ExTFP were not provided a schedule or description of the degree 
progra r> In the brochure, but were required to request information about 
the doctoral program from the director of the ExTFP. This procedure was 
followed because the Ph.D. program has several components that, include 
specific requirements as well as general requirements that the individual 
candidate for the degree establishes in cooperation with his degree 
committee . 

The Ph.D. in Secondary Education with a Concentration in Economic 
Education was prepared by the chairman of the Department of Economic 
Education and the chairman of the Department of ,'econdary Education; 
a proposal for the degree was submitted to the University curriculum 
committees and the Ohio Board of Regents in 1966 and approved In ^arch, 
1968, In general, students In this degree program are expected to 
complete a minimum of 65 quarter credits each in (1) education, and (2) 
economics and economic education, Tn the education component of the 
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program, a candidate usually concentrates his work in the areas of 
(1) statistics, ( 2 ) research and design, and (3) curriculum development. 

In economics, candidates are expected to demonstrate competency of basic 
economic theory Including national income analysis, microeconomics, 
macroeconomics, economic history, comparative economic systems, 
money and banking, international economics, public finance, the eco- 
nomics of human resources, and labor economics. This broad coverage 
rather than content specialization, couped with course work in economic 
education, is considered necessary to qualify a candidate as an economic 
education specialist. The complete schedule of course requirements for 
the Ph.D. is Included in Appendix I. 

Besides the required course work, candidates for the Ph.D. are 
expected to pass (1) a statistics proficiency test, prepared and administered 
by the educational statistics faculty in the University's College of Edu- 
cation, and ( 2 ) a standardized modern foreign language proficiency test 
prepared by the educational testing service of Princeton, New Jersey. 
Additionally, degree candidates are expected to file a record of scores 
obtained on the Graduate Record Examination (GRE) and to satisfactorily 
complete an Advanced Writing Test prepared and scored by the Graduate 
Committee of the Department of Secondary Education. Finally, each 
candidate must submit a dissertation for approval by his program committee. 

The Ph.D. program consists of a blend of course work in education, 
economics , and economic education directed specifically toward potential 
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leaders in teacher education and with an emphasis in economic edu- 
cation. Although the degree is in secondary education, the degree 
program represents a cooperative effort of the Departments of Second 
ary Education and Economic Education. A candidate's committee chair- 
man and advisor in education is selected from the faculty of the De- 
partment of Secondary Education; the advisor in economics and eco- 
nomic education is selected from the faculty of the Department of Eco- 
nomic Education. Although the number of courses required for the de- 
gree may be greater than are required in some doctoral programs , the 
two departments have taken a liberal attitude toward the transfer of 
credits from other colleges and universities. Tn fact, candidates for 
the degree are expected to hold an ^/.A. in (1) economics or (2) edu- 
cation before they may be accepted into the program. Applicable cre- 
dits earned in other degree programs may be transferred and applied to 
the Ph.D. program at Ohio University with the consent of the advisor 
in the respective departments. Even with this policy toward transfer 
credits, few individuals can complete the degree program in less than 

two years . _ . 

Besides the normal course requirements for either the A '.A. or the 
Ph.D. , Fellows in the ExTFP participated tn (1) a practicum experience, 
and (2) a group process experience. Participation in these activities 
or experiences was mandatory because of the nature and design of the 
ExTFP; they are normally not part of either degree program at Ohio 
University. 



113 



Designing the program . The co-authors of the proposal submitted 



to the USOE requesting support for the ExTFP were the then proposed 
director and associate director of the ExTFP. The proposal was a de- 
tailed and at times repetitious document that elaborated on many of the 
suggestions found in the proposal guidelines. For Instance, In develop- 
ing a rationale for special teacher education programs for educational 
personnel employed in poverty areas, the authors of theproposal devoted 
fifteen pages to a statement of need. 

The detailed and punctilious elaboration found In the proposal was 
in no small part influenced by the experiences of the previous year. The 
Department of Economic Education had administered an Experienced Teacher 
Fellowship Program during the academic year 1967-68, To the chagrin of 
all those associated with the 1967-68 program, and despite guidelines 
information that previously supported programs would be given preference 
and rumors that the USOE administration would support a similar program 
during the year 1968-69, the proposal submitted for 1968-69 was not funded. 
The Impact of this withdrawal of support posed an immediate threat to 
the newly established Department of Economic Education . "Tooling up" 
for special programs Included the addition of faculty and staff members 
and the purchase and rental of office equipment in order to conduct these 
programs in an efficient and effective manner. The withdrawal of support 
after one year placed considerable strain on a new academic unit still strug- 
gling for existence and recognition in the "high church." 
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Despite the frustrations that ensued, the Department survived the 
year 19S8-S9. Realizing, however, that a failure to gain support in 
another year would severely cripple the Department and frustrate plans 
for the continued institutionalization of economic education at the 
University, the proposed director and associate director of the 1968-69 
Experienced Teacher Fellowship Program met in Washington , D. C. with 
staff members of the USOE to discuss '1) procedures in the selection 
process for supporting Experienced Teacher Fellowship Programs, (2) 
the specific content of the 1968-69 proposal in economic education sub- 
mitted by the Department, and (3) the status of the Department of Economic 
Education with the USOE administration in regards to the submission of 
a program proposal for 1969-70. Several members of the USOE staff met 
with the proposed director and associate director in a generally cordial 
atmosphere to discuss the three areas of concern* 

Regarding the first topic, the USOE staff members present defended 
the procedure used for proposal reading and evaluation. This procedure 
was one of having proposed directors of proposed programs read and 
evaluate the submitted proposals, i.e. the proposed directors of proposed 
programs that were among the competition. The rationale for this procedure 
was that these individuals, as opposed to other individuals, were more 
likely to be familiar with the objectives of the USOE administration in 
granting program support and were therefore in a better position to know 
V what proposals held the greatest promise for attaining these objectives. 

er!c 
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The USOE staff members present noted further that the proposal 
under discussion had not been reco r, mended by the proposal readers. 
However, they did recognize and state that the withdrawal of support 
after one year did likely create a difficult situation for an institution that 
was prepared to move forward with a second program. Further, although 
the USOE representatives present said that the USOE staff had acted in 
good faith (a point that was not debated) there remained some question 
over the amount of attention paid by the proposal readers to the point 
in the guidelines that programs supported in 1967-68 would be given a 
preference for renewal in 1968-69. Finally, the USOE representatives 
present during t.he formal session commented on several occasions that 
the proposal under discussion was "a good one." 

The third area of concern, viz . , the status of the Department of Eco- 
nomic Education with the USOE, was not discussed directly in the formal 
meeting, but the general tone of the meeting suggested that there was no 
animosity between the two parties. The second topic, involving the spe- 
cific proposal under discussion was not given great attention during the 
formal session, but was discussed during an informal session by the pro- 
posed director and associate director and two representatives from the 
USOE. During this discussion, the USOE representatives commented on 
the overall good rating of the proposal, but suggested areas of improvement 
for any future proposals to include (1) a clearly defined practicum, (2) 
a clearly defined rationale for selecting participants from grades 1 through 
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12, and '3) greater detail in the evaluation and follow-up procedures. 

'It was somewhat Ironic that later in that month, March, 1968, the Depart- 
ment of Economic Education held a one wekk "Special Clinic" for NDEA 
and NSF directors of economic Institutes to provide suggestions for pro- 
gram. effectiveness to the directors of institutes which were funded. The 
Special Clinic was supported through the USOE.) 

Because of the experience with the 1968-59 proposal, coupled with 
the information gained during the sessions in Washington, D. G. in March, 
proposal for progra n support for the ExTFP contained detailed plans 
describing a practlcum experience, a group process experience, adminis- 
trative plans, program balance, extensive Internal and external program 
evaluation plans, and other special features. An example of a special fea- 
ture in the design of the ExTFP was the request for support and the subse- 
quent approval for two specific types of participants, viz . , (1) post-M.A. 
Fellows who came to the campus to pursue the Ph.D. in Secondary Edu- 
cation, and (2) M.A. candidates in pursuit of the M.A. in Economic Edu- 
cation. The ExTF° was probably the only Experienced Teacher Fellowship 
Program in any discipline in the nation that included this mix of partici- 
pants . The original proposal had requested support for twenty-five M.A. 
candidates and five post-V.A. candidates. After negotiation with the 
USOE coordinating staff, support was granted for fourteen M.A. and eight 
post-M.A. Fellows, 

Another special feature included in the proposal was a request for the 



117 



107 



{ 






support of a pre-program project directed toward the recruitment of experi- 
enced teachers from the entire state of West Virginia, eastern Kentucky, 
and southeastern Ohio. This pre-program project was Included in the pro- 
posal because of the previous experiences with participant recruitment. The 
1967-68 program had been directed toward experienced teachers employed. 

In school systems In the thirteen state area comprising Appalachia. Be- 
cause of an insufficient number of applications from teachers who qualified 
for graduate studies at the University, it became necessary to design a 
cooperative arrangement with the director of a similar program in economics 
which was not restricted to a geographical region and who had on file more 
qualified applicants than his program could support. Following this 
arrangement, some of the participants in the 1967-68 program were indi- 
viduals who were not from school systems in the Appalachian Region, and 
furthermore, were individuals who had not applied for the program at Ohio 
University. Because of this experience, the proposal for an Experienced 
Teacher Fellowship Program, 1968-69, called for teacher participation on 
a national level, and made no specific reference to educational personnel 
employed in poverty areas. 

The proposed pre-program project Included in the ExTFP proposal 
called for the then proposed associate director to visit schools in poverty 
communities in the tri-states of West Virginia, Kentucky, and Ohio In an 
attempt to inform teachers of the program and recruit potentially qualified 
educational personnel. The authors of the proposal recognized, however, 
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that, (1) the UROE administration night not support this special project 
even though the ExTF p night receive support, and ( 2 ) that even with the 
precaution of this pre-program project, a sufficient, number of applicants 
might not apply for the program. Therefore, while the program was directed 
toward educational personnel In the tri-state area, it was expanded +o in- 
clude the entire region of Appalachia and educational personnel in "other 
poverty areas, rural and urban." 

Although the ExTFP proposal was supported, funds were not provided 
to conduct the special pre-program project. As an alternative, a neasure 
was taken to disseminate information about the program in the trl-state 
area In an effort, to attract potentially qualified applicants to the program. 
Through a special request, the Appalachian Regional Laboratory, located 
in Charleston, West Virginia, supplied the Department with. name and 
address labels of educational personnel and business and political leaders 
In the trl-state Appalachian Region. About 500 of the 1500 labels supplied 
through the Appalachian Regional Laboratory were attached to program 
brochures and mailed to superintendents, principals, department chairmen, 
and some teachers in the trl-state area. Despite this added effort, there 
were no applications received from educational personnel e mployed In 
school systems in Kentucky and only three from West Virginia. The three 
West Virginian teachers who made applications were accepted to participate 
In the program; however, one of these participants withdrew from the pro- 
gram after the first two weeks . As an aside, when asked how he had heard 
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of the program prior to making application, one of the participants from 
West Virginia informed the associate director that his principal had 
"reached Into a desk drawer" and supplied him with the brochure 
during a discussion In which the teacher had expressed an interest 
in pursuing graduate work. 

Unce It was not feasible to supply the necessary details of the 
Ph.D. program In the brochure, educational personnel interested in the 
Ph.D. portion of the ExTFP were encouraged in the program brochure to 
request further .Infor nation from the program director. Generally to be 
eligible for the Ph.D. portion of the program, applicants were expected 
to hold an ' T .A. In economics or education. Further, each applicant was 
expected to have a solid academic record and good letters of recom- 
mendation. Tt was hoped that individuals with the greatest potential 
for leadership roles upon completion of the program would apply and 
subsequently be accepted to participate In the ExTFP. 

As with the Ph.D. applicants, the A./*. A. applicants were selected 
on a national basis . Although It was hoped that a large number of quali- 
fied educational personnel In rural poverty communities, such as the 
Appalachian regions of the trl-states of Ohio, West Virginia, and Kentucky, 
and inter-city poverty areas would apply for the program, applications were 
accepted on a national basis. An applicant was considered eligible for the 
program If he held a baccalaureate degree from an accredited institution with 
a minimum of 2.5 grade average 'where A=4.0), a standard teaching cert.1- 
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flcate, and three or more years of teaching experience. The progra m brochure 
noted five minimum eligibility requirements: 

Ql Hold a baccalaureate degree from a recognized college or 
university 

' 2 ) Hold a standard teaching certificate 

(3) Be a teacher, department chairman, or curriculum supervisor 
at the time of application 

(4) Obtain a leave of absence from the school system where 
presently employed 

(5) Supply academic records and letters of reference and com- 
plete necessary application forms . 

Each applicant was expected to state In a page or two the reason for making 
application along with the benefits he expected to accrue to himself and 
the school system where he was employed. Each applicant was also re- 
quested to complete two graduate college forms and two USOE forms. 

The program brochure Identified selection procedures and Indicated 
that each applicant would be ludged according to Individual merit as regards 
the applicant and the school system where he was employed. The program 
brochure also Identified the following criteria to be used In the selection 
process- 

(1) Preference will be given to teachers, chairman, and curri- 
culum supervisors from Appalachia and other economically 
depressed areas, both rural and urban 

( 2 ) Reference will be given to applicants who appear academic- 
ally qualified to complete the program. This judgment will 
be based on the applicant's professional experiences, aca- 
demic preparation, teaching or administrative assignment, 
recommendations, and a letter explaining why he wishes to 
be considered for participation. 

This second preference was Included In an attempt to encourage application 
by a sufficient number of Individuals. Over 500 letters of inquiry were 
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made into the program. Ninety-five applicants for the v/r .A. completed 
the application requirements and were considered for the program; thirty 
completed application forms were received by Individuals Interested In 
the Ph.D. program Upon receipt of an applicant's transcripts, letters 
of recommendation, and other requisite materials, an individual file 
was prepared. The associate director of the program prepared charts 
that indicated the na me and address of each applicant along with other 
Information Including age, sex, years of teaching experience, educa- 
tional degrees, preparation in economics, type of school system, and 
location of school system. This Information, along with other relevant 
data that helped to Identify each Individual, was taken from the 
Individual files . 

The Selection Committee consisted of a five-member group In- 
cluding (1) the program director, ^2) the associate director, f3) a staff 
member of the OCEE, (4) a staff member of the Department of Economics 
and (5) a staff member of the Department of Secondary Education. 

Since it was not possible for each of these individuals on the Selec- 
tion Committee to be personally familiar with each of the 125 applicants 
as known through their files, t.he associate director, who had been 
responsible for most correspondence with the applicants and who was 
most familiar with the Individual files, supplied the Committee with 
specific Information that was not Included on the applicant roster. 



The Committee took seriously the task of evaluating each appli- 
cant for the program and was conscious of the program preferences, 
viz., educational personnel teaching In economically depressed areas, 
and applicants who appeared academically qualified to co nplet the 
program. Because these stated preferences were taken Into account, 
some applicants with superior academic records were not Invited to 
participate In the program whereas In some Instances, applicants who 
appeared less qualified academically were selected. The Committee 
was careful, however, In trying to avoid the selection of Individuals 
who did not appear academically qualified to complete the program. 

Additional variables Included In the selection process were the 
conscious attempts to select educational personnel employed In 
Appalachian school districts, and beyond that, to select Individuals 
representing a broad geographical distribution. The Committee also 
tried to Include Individuals who represented public, private, and 
parochial schools, and applicants employed as teachers, curriculum 
supervisors, department chairmen, and principals. Finally, although 
fewer females and fewer elementary teachers had made application for 
the program, the Committee made a conscious attempt to select females 
and elementary teachers to participate In the ExTFP In a proportion 
relative to the number of female and elementary school teacher appli- 
cants . 
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Student characteristics . The original proposal submitted to the USOE 
requested support for five post- A '.A. and twenty-five >'.A. Fellows. After 
the initial negotiations with the USOE, support was granted for six post- 
V.A. and ten V.A. Fellows. These figures were used in the program 
brochure . Subsequently, the USOE provided support for twenty-two 
Fellows , eight of whom were selected for the post- V.A. or doctoral pro- 
gram, while the remaining fourteen were selected to pursue the v.A. in 
Economic Education. 

Three promising candidates for the doctoral program withdrew their 
names just prior to the meeting of the Selection Committee. Of the eight 
selected from the remaining twenty-eight who had completed their applica- 
tion files by the deadline date, one did not accept the fellowship; an 
alternate was selected in his place. Of the fourteen V.A. applicants 
selected to participate in the ExTFP, five did not accept. Five alternates 
were selected to replace the original five. 

Despite the care with which the Selection Committee had proceeded, 
further changes in the program constituency became necessary shortly 
after the program was underway. One of the ^.A. Fellows did not arrive 
on the opening day of the program. In a telephone call made by the 
associate director later In the week, It was learned that medical reasons 
would prevent this Individual from participating in the program. Fortunately, 
finding a replacement was not difficult. One of the program alternates 
had come to the University to pursue the M.A. in Economic Education with 
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or without a fellowship. This individual accepted the invitation to fill the 
position. After the progra m was in session for two weeks, and again 
because of medical reasons, a second V.A. Fellow asked to withdraw 
from the program. This request was granted. The alternate selected for 
replacement had accepted the opportunity to participate in a summer in- 
stitute and could not ioin the program for another four weeks. Having 
missed the first six of a scheduled eight week su mmer program, this 
participant worked at a distinct disadvantage, especially in the early part 
of the progra m. 

Particularly disappointing and unexpected was the withdrawal of 
another individual from the program after the end of the summer session. 
This promising '*.A. Fellow had not informed anyone of his plans, in- 
cluding the administrative staff, the faculty, or the other Fellows in the 
program. When he did not return in time for the non-credit group pro- 
cess sessions, he was reached by telephone. In the ensuing conver- 
sation he Informed the associate director that he would not return to the 
program due to medical reasons. It was deemed unwise to try to replace 
this participant at this late date since any replacement would likely be 
teaching by this time and would find it difficult to loin a progra m well 
under way. With the approval of the USOE program representative, a stu- 
dent already pursuing the Ph.D. in Secondary Education was awarded 
the program stipend. Since this individual joined the program late in the 




Fall Quarter, was advanced In his degree work, and had completed all 
the courses planned for the program Fellows, including the en bloc 
economic education courses, he was not considered a Fellow nor in- 
cluded in the evaluation study. The total number of participants was 
figured as twenty-one despite the fact that there were technically 
twenty-two individuals who received support through the program. 

One further change was made during the year. One of tit a Fellows 
who had been accepted as a candidate for the p h.D. program held the 
equivalent of an *' 7 .A. but not the degree itself. ^Acceptance for the Ph.D. 
degree program was an oversight in the selection process.) Furthermore, 
formal course work in economics dated back, for the most part, some 
ten years and this Fellow chose, therefore, to attend most of the en bloc 
courses in economics with the M.A. Fellows. Toward the end of the 
program, this participant decided not to continue with the Ph.D. program, 
but Instead to complete the requirements for the VQA. in Economic Edu- 
cation only. 

In summary, one Ph.D. applicant accepted for the program did not 
accept the fellowship and was replaced by an alternate. A second Ph.D. 
candidate decided to pursue the M.A. in Economic Education and not con- 
tinue the Ph.D. program. Of the original fourteen applicants accepted for 
the "' r .A. component pf the program, five did not accept, and two withdrew 
after the program was underway; five alternates were selected and one 
position remained unfilled, (although thr stipend was in fact used) . In 
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the final tally, there were a total of twenty-one participants consisting 
of seven p h.D. Fellows and fourteen V.A. Fellows. 

The twenty-one Fellows Included In the final roster consisted of 
nineteen males and two females, a sex distribution that was neither 
representative of all educational personnel in the nation nor the 
composite population for all Experienced Teacher Fellowship Programs, 
1956-67, and 1967-68. The mean age of the Fellows was 35.0. The 
mean number of years in education for the Fellows was 9.7. Tables 
IV, V, and VI Indicate by percentage how the Fellows compared to the 
composite percentage figures of Experienced Teacher Fellowship 
Programs, 1966-67, and 1967-68. (The figures used in the comparison 
were drawn from the Crockett, et al. , report on Experienced Teacher 
Fellowship Programs, 1967-68.) 



TABLE TV 

SEX DISTRIBUTION OF THE FELLOWS BY PERCENT COMPARED TO THE 
COMPOSITE POPULATION FOR ALL EXPERIENCED TEACHER FELLOWS , 

1966-67 AND 1967-68 




1966-67 1967-68 ExTFP 



•'■'ale 51.3 59.3 90.5 

Female 48.5 40.7 9.5 

No response 0.3 0.0 0.0 
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TABLE V 



AGE DISTRIBUTION OF THE FELLOWS BY PERCENT COMPARED 
TO THE COMPOSITE POPULATION FOR ALL EXPERIENCED 
FELLOWS, 1S66-67 AND 1967-68 





Age 


.1966-67 


1967-58 


ExTF? 



20-29 




30.0 


33.3 


30-39 ....... 


. . 51.1 


46.0 


46.0 


40-49 ....... 


16.1 


20.0 


14.3 


50-59 


3.9 


3.8 


4.7 


60 and over .... 




0,0 


0.0 


No response .... 


. . 0.6 


0.2 


0.0 





TABLE VI 

THE NUMBER OF YEARS IN EDUCATION OF THE FELLOWS 
BY PERCENT COMPARED TO THE COMPOSITE POPULATION 
FOR ALL EXPERIENCED TEACHER FELLOWS, 1966-67 AND 

1967-68 





Nu Tiber of years 


1966-67 


1967-68 


ExTFP 



Less than 3 


8.4 


8.5 


4.8 


3-5 


32.8 


31.3 


19.0 


6-10 


34.6 


33.9 


42.9 


11-20 


20.7 


23.9 


28.6 


21-25 


1.9 


1.2 


4.8 


Over 26 


1.4 


1.1 


0.0 


No response 


0.0 


0.2 


0.0 
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In the year prior to participation in the program, the Fellows had 
worked at. different levels In education. Table VII suggests the variation 
among the participants prior to entry into the program. 

TABLE VII 

EDUCATIONAL LEVEL AT WHICH THE FELLOWS TAUGHT 

Das ition 

Elementary Teacher 

Junior High Teacher 

High School Teacher 

High School Principal 

School Superintendent ..... 

College Teacher or Administrator 

As undergraduates two of the twenty-one Fellows had majored In 
economics; fourteen had majored In history or social sciences other than 
economics. Four participants had majored In education, and the remaining 
one in physical education. Prior to entry into the program, four of the 
twenty-one Fellows had had no formal course work in economics, either 
at the undergraduate or graduate level; seven had no college course credits 
in economics beyond the basic Introductory or principles level. Similarly, 
nine of the twenty-one Fellows had taken no course work In higher mathe- 
matics at the undergraduate or graduate level; eleven had taken at least 
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Number of Fellows 
1 

3 

12 

1 

1 

3 
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a course in basic algebra but only one had taken courses in calculus . 

The record of formal preparation in economics and mathematics on 
the part of these experienced teachers is worthy of some note, in a pro- 
gram with the preponderance of course work in the M.A. portion in econo- 
mics at the graduate level, it is not surprising that several of the econo- 
mics instructors found the level of comprehension among the Fellows to be 
deficient. The failure to grasp meanings and to see relationships, espec- 
ially early In the program and usually early In the various courses, was 
undoubtedly due to the lack of preparation in economics and mathematics, 
the latter being the language of the former in many instances. Yet It 
was precisely this condition that the program was trying to correct. As 
noted by one economics Instructor, the Introduction of "New Vath" in 
elementary and secondary schools may make elementary and secondary stu- 
dents more sophisticated in their knowledge and use of mathematical 
symbols and terms. In time, these students will be able to comprehend 
more readily economics concepts that are couched In mathematical terms. 

To become more analytical in their own approaches to economics, and In the 
social sciences generally, it will become Increasingly necessary to 
strengthen the background of experienced teachers who lack a knowledge 
of economics and social science concepts as well as a knowledge of the 
tools and logic with which the professional economist and social scientist 
proceeds . 




Of the twenty-one Fellows , eighteen taught In public schools in the 
year prior to participation in the program, two taught in parochial schools 
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and one In a private school. Although a serious effort had been 'Tiade 
to attract applications from the Appalachian Region, and especially the 
tri-state Appalachian sectors of Ohio, eastern Kentucky, and all of 
West Virginia, the participants represented a wide geographical 
distribution. Table VIII indicates this distribution. 



TABLE VIII 

GEOGRAPHIC DISTRIBUTION 



State 








Number of 
Ph.D. Fellows 


Number of 
‘•".A. Fellows 


Total 


California. • 


• 






1 


2 


3 


Delaware • • 








0 


1 


1 


Louisiana • • 








0 


T 

KJ 


3 


Maryland • • 








1 


0 


1 


V'lchlgan • • 








0 


1 


1 


Minnesota • 








2 


0 


2 


'Isslsslppl • 








0 


1 


1 


New Jersey • 








0 


1 


1 


New York • • 








1 


1 


2 


Ohio • • • • 








1 


1 


2 


Virginia* • • 








1 


0 


1 


Washington • 








0 


1 


1 


West Virginia 


• 






0 


2 


2 


Although there were two Fellows In the program who had taught In West 



Virginia, as Indicated earlier, there were no applications received from 
educational personnel In Kentucky; the two Fellows from Ohio were not 
from the Appalachian portion of the state. Aside from the two Fellows 
from West Virginia, five of the remaining twelve W , A . Fellows had taught 
In large inner-city school systems, two In small-town rural communities, 
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The Fellows and the teaching faculty were asked to judge the general 
level of ability of the Fellows relative to graduate students not in the 
ExTFP. The opinions are indicated in Table IX. Although the Fellows were 
not asked to make a distinction between Ph.D. and M.A. Fellows, this 
distinction was probably observed in responding to the question. Faculty 
opinions likely reflected the different contacts that were made during the 
year. 



TABLE IX 

RATINGS OF THE ABILITY LEVEL OF THE FELLOWS RELATIVE 
TO GRADUATE STUDENTS IN THE SA' IE FIELD 



p h.D. M.A. Education Economics Econ. Educ. 

Fellows Fellows Faculty Faculty Faculty 



Much Higher. . 


5 


2 


1 


0 


1 


Slightly higher. 


2 


7 


4 


1 


2 


About the same . 


0 


5 


1 


1 


0 


Slightly lower . 


0 


0 


0 


4 


0 


Much lower . . 


0 


0 


0 


1 


0 



Tn summary, the Fellows comprised a homogeneous group in regards 
to vocation; however, there was evident variation within the group in 
regards to ability, age, professional experiences, and preparation in the 
subject-matter fields . This variation was intended and expected, at 
least by the administrative staff. 
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The Fellows represented, therefore, a challenging group. Although 
they shared a common vocation and interest, their personal goals, 
experiences, and prospects differed. For instance, some of the Fellows 
could be expected to become leaders in teacher education at a national 
level upon completion of the program while others could be expected to 
provide better classroom instruction and community leadership in inner- 
city schools and rural poverty school districts upon returning to their 
former positions. It became the challenge of the administrative staff and 
the faculty, therefore, to guide the Fellows and develop wLthln them the 
leadership qualities that would contribute to positive changes in education 
at the several levels where the Fellows might be employed upon com- 
pletion of the program. 



ITT. TRANSACTION'! 

Courses . Although the original plans for the ExTFP had called for 
en bloc programming for the M.A. Fellows, three exceptions were made 
that included 'll Economic History of the United States, (2) Economics 
of Poverty, and (3) Economics of Human Resources. In each of these 
courses, however, the Fellows constituted a majority of the class. The 
Ph.D. Fellows followed an _en bloc schedule with the M.A. Fellows for 
courses that Included (11 Advanced Principles of Education , (2) Educa- 
tional Statistics I, (3) the economic education sequence of courses, and 
(4) the two scheduled practlcum courses. Additionally, allot the Fellows 
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were involved In the group process sessions. 

The su nmer program of courses served In a sense as an antecedent 
condition to the academic year program. To allow the Fellows sufficient 
time to find housing and settle in the community, the four three-credit 
summer courses were scheduled to begin two weeks after the regular first 
term of the summer session at the University. By reducing each of the 
two scheduled terms by one week, the summer program concluded on 
August 23, the scheduled closing date of the regular University summer 
progra ort . 

Recognizing that s everal of the A .A. Fellows were deficient in 
their formal preparation in economics , and recognizing further that the 
degree requirement consisted of a minimum of twenty-seven quarter cred- 
its in advanced economics, one course of each term during the summer 
s .ssion was devoted primarily to Introductory economic theories. These 
courses were directed primarily toward a study of the basic economic 
Ideas, concepts, and generalizations which would be studied more in- 
tensively In the various economics courses scheduled for the academic 
year. 

Discussions with the V . A . Fellows and the instructors In the summer 
courses In economics revealed that the su mmer courses did not serve their 
stated purpose as well as was intended. Essentially, the plans had called 
for a four-week course In "basic" microeconomics and a four-week course 
In "basic" macroeconomics. At least to some extent, the instructors 
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failed to recognize the special needs and characteristics of the Fellows 
and did not therefore viake a sufficient adjustment in their teaching 
strategies or the course content. For some Fellows, it was not sufficient 
to scale the course down to a level appropriate for undergraduate juniors 
and seniors. More Importantly, perhaps, was the fact that the dif- 
ficulties that the Fellows encountered during the su nmer courses In 
economics were a result of the economics Illiteracy that persists, even 
among experienced teachers of social studies and social sciences. Yet, 
it was this general deficiency that this and similar programs in economic 
education were trying to eradicate. 

The summer course In education was an en bloc course for both 
M'.a. and Ph.D. Fellows taught by a veteran, social science teacher 
educator from the College of Education. This course, taught during the 
first four weeks of the Summer Quarter, was included in the schedule to 
serve the same purpose in education that the two Introductory courses 
in economics were directed to in that discipline. Differing In format from 
the Introductory economic courses, the instructor In the education course 
maintained a relaxed atmosphere In the classroom, encouraged Inter- 
action among the Fellows, and within a broad structure, allowed the Fellows 
to determine their own learning pace. During Informal discussions with 
the Fellows, there was some expression of apprehension and frustration 
ever this approach, an approach with which many of the Fellows were un- 
accustomed. The course did, however, provide a change of pace and drew 
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a number of favorable comments later in the year. In the final question- 
naire, the course instructor acknowledged that "some may not have made 
the quick adjustment to my method." In response to a later question 
pertaining to the utilization of the Fellows' experiences and background, 
he commented that "in some respects such interaction was the key to our 
success . " 

The three courses in economic education, excluding the practicum, 
were offered seriatim during the Summer, Fall, and Winter Quarters for 
three quarter credits each; a fourth course was offered during the Spring 
Quarter for one credit for the .'/.A. Fellows only. The courses were team 
taught by the director and associate director of the program and therefore 
served the dual purpose of making the Fellows and the program adminis- 
trators more familiar with one another. To create a relaxed atmosphere, 
grades were Issued only upon request. With minor exception, most Fellows 
took these courses for credit. 

As suggested earlier, It was the primary purpose of these courses 
to help the Fellows to translate concepts, Ideas, and generalizations 
learned in the economics and education courses into viable curricula suited 
for elementary and secondary school systems and students . To accom- 
plish this, the instructors of the courses exposed the Fellows to some of 
the new curriculum materials in economic education that had been developed 
through special projects in recent years . These materials Included (1) a 
new approach to the teaching of economics intended for junior high students 
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called Life on p aradlse Island by Roman F- Warmke, f2) the ninth grade 
economics curriculum materials developed by Meno Lovensteln, et al. 
called Developmen t of Economics Curricular Materials for lecondary 
Schools , ' 3 ) the elementary grades economics materials developed by 
Lawrence Senesh called Our Working World as well as other materials 
that explain the rationale of this series, ^4) the Econ 12 materials 
developed by Susan Wiggins Helburn, (5) a book entitled What Is Eco- 
nomics ? written by John E. ^aher, (6) materials on the unified approach 
in the social sciences prepared by Alfred Kuhn and (7) materials from the 
Manpower and E conomic Education developed by Robert L. Darcy and 
Phillip E. Powell. These materials and others and the supporting rationale 
and emphasis of each author provided the basic content for the Summer 
Quarter course in economic education. 

During the Ihll Quarter, all of the above authors and project dir- 
ectors accepted an Invitation to address the Fellows In order to discuss 
at greater length the materials they had developed and the rationale sup- 
porting these materials . Meanwhile, the Fellows had the dual assign- 
ment of (1) reading selected materials in advance of the guest speaker 
and (2) developing an outline providing the structure for the colloquium 
paper that was scheduled to be submitted In the Spring Quarter. 

Classes during the Winter Quarter consisted of seminar sessions in 
which the Fellows presented the major strategy and content of their 
colloquium papers. Presentations usually evoked considerable dis- 
cussion since the Fellows were at ease with each other and the instructors 
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were Involved In a common purpose. The final copies of the colloquium 
paper were submitted during the Spring Quarter after each Fellow had 
gained approval of a draft of the paper prior to the due date. The collo- 
quium papers wore bound and were left In the OCEE's Curriculum Materials 
Laboratory; Fellows wishing a bound copy for themselves submitted a 
second copy. 

Although the major emphasis In the economic education courses 
was on economics as it relates to the curriculum, some sessions were 
devoted to currlculu n development and the place of economics In the 
total elementary and secondary school curriculum. It had originally been 
planned that greater emphasis would be placed on related social sciences 
and how they relate to economics and, in turn, to the curriculum. Time 
limitations prevented an in-depth study of these topics. 

A maior purpose of the courses in economic education was to pro- 
vide the Fellows with an opportunity to synthesize educational and pro- 
fessional experiences, a process that was to culminate in the collo- 
quium paper. One of the Fellows commented in class, and to the class, 
that this In fact was being accomplished, and that. Indeed, this was 
one of the highest forms of educational activity. Some Fellows may not 
have recognized that they were in fact synthesizing a number of experi- 
ences; others were probably not doing so. 

Regarding courses In economic education, the external evaluator 
found "little specific mention of courses taken In this field." The failure 
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to make specific comments about the courses in economic education may 
simply have been due to the fact that the economic education courses 
had been essentially completed during the previous quarter and since 
they were not asked specific questions about the subject, many Fellows 
failed to make specific reference to these courses. Several of the Fellows 
commented privately to the associate director that the colloquiu m paper 
had been a satisfying activity and yet the most demanding activity during 
the entire year. Some further Indication of the effectiveness of the courses 
in economic education in translating content Into viable curricula and 
effective teaching strategies is indicated In Table X. 



TABLE X 

FELLOWS' OPINIONS OF THE EFFECTIVENESS OF THE 
ECONOMIC EDUCATION COUPSES 



Effectiveness of economic 
education courses 


Ph.D. 

Fellows 


M.A. 

Fellows 


Total 


Very effective 


5 


3 


8 


Effective 


2 


7 


9 


Slightly effective 


0 


4 


4 


Not effective at all 


0 


0 


0 



Table X indicates that four of the A. Fellows found the course 
work in economic education to be only slightly effective. Since these 
( ) individuals represented over 28 per cent of the V.A. Fellows, 
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careful consideration will need to be given to the content and approaches 
used in these courses, it had been hoped by the course Instructors that 
classes in economic education would be effective and helpful. Perhaps, 
and hopefully, the Impact of the experiences in these courses will become 
manifest at a later time. 

The grouping of students with a defined background and common 
interests gave the instructors in the en bloc courses an opportunity to 
conduct classes that would produce a multiplier effect since the students in 
these classes Could be expected to return to classroom teaching or some 
other educational endeavor and have a direct influence upon the educational 
process. That is, the Fellows comprised a group who had experienced the 
rigors of elementary and secondary teaching and were now in search of 
new approaches and content that could be used in another context. 

Given the preparation and' formal course work in economics and in 
mathematics that the Fellows had prior to participation in the program it 
Is not surprising that the external evaluator found that "several r Fellows] 
were especially sensitive to the math requirements for which* they saw 
themselves ill-prepared." Later in the report, he noted that "the bulk 
of ’'".A. candidates displayed varying degrees of anxiety relative to the 
requirements in economics." 

There is some question as to how prepared the course instructors were 
to adjust their teaching to the specific needs of a special group of experi- 
enced elementary and secondary teachers. This adjustment required both an 
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Identification of the particular needs of this rather homogeneous group 
as well as the use of teaching strategies aimed at influencing the 
approaches that could In turn be used by the experienced teachers In their 
own classroom situations. The Incentive to Instructors for making these 
kinds of adjustments in both content and strategy may emanate from two 
sources Including 'll the instructor's commitment to a special program and 
the participants in the program, and (21 the extent of recognition for 
superior teaching as compared to research in a college or university. Al- 
though in theory there is recognition given to excellence in teaching, there 
is little evidence to indicate that excellent teaching is given the same 
honor as research and publications. Instructors who did not recognize the 
opportunity to examine new techniques may have been victims of the 
publication syndrome. 

Other Instructors may have had a different perception of the duties 
and functions of educational personnel in colleges and universities as 
compared to the duties and functions of educational personnel in elementary 
and secondary schools. In response to a question on the faculty question- 
naire that Inquired after the extent to which the ExTFP was imaginative 
and innovative, one Instructor found that it was "not very imaginative or 
innovative." In making comment on this choice, he explained that he was 
". . .not sure that it ought to be." To him, too much time may be spent 
"glamorizing and in innovation." Finally, he was of the opinion that it is 
the responsibility of a university to emphasize the disciplines; "imagination 
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should be done at the home schools." Although this opinion may not h*ve 
been shared by other Instructors (and was not by many), there was 
apparently little effort made by this Instructor to recognize or meet the 
special needs of the Fellows. 

In an attempt to assess the several courses and the teaching 
abilities of the faculty, the Fellows were asked to respond to several 
questions in the final questionnaire; the teaching faculty was in turn 
asked to respond to several questions relative to the Fellows. These 
responses are in many instances relative to previous experiences of 
those completing the questionnaires and it is therefore difficult to arrive 
at any conclusive evidence based on these responses. Nonetheless, the 
several tables that follow may give some Indication of the experiences 
in the various courses and the ensuing attitudes that developed. 

An assessment of the teaching abilities of the course instructors 
is provided in Table XI. With only minor exception, the abilities of the 
teaching faculty were rated from good to superior by the Fellows. 
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TABLE XI 

FELLOWS’ OPINIONS OF THE TEACHING ABILITIES OF INSTRUCTORS 





Instructors' teaching 
abilities 


Ph.D. 

Fellows 


M.A. 

Fellows 


Total 


Without exception, the 
teaching was superior .... 


2 


1 


3 


With one or two exceptions , 
the teaching was superior . • 


4 


3 


7 


Overall, the teaching was good 


1 


9 


10 


Overall, the teaching was 
adequate 


0 


0 


0 


With one or two exceptions , the 
teaching was below standard . 


0 „ 


1 


1 


Without exception, the teaching 
was below standard 


0 


0 


0 



Although the Fellows rated the teaching faculty as generally good to 
superior, the teaching faculty apparently did little in their own classes or 
observed little in the program generally that indicated an innovation In the 
teaching of their subjects. Table XU gives some indication of the extent 
to which the faculty developed or observed innovative teaching methods or 
practices . 
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TABLE XII 



FACULTY OBSERVATION OF INNOVATIVE TEACHING 
METHODS AND PRACTICES 



Have you used, developed 
or observed any Innovative 
teaching methods of prac- 
tices In your work with the 
ExTFP? 


Education 

Faculty 


Economics 

Faculty 


Econ.Educ. Total 
Faculty 


Yes 


2 


2 


2 6 


No 


4 


5 


1 10 


Unsure 


1 


0 


0 1 



Based on the responses to the question found In Table XII, the teaching 
faculty was in large part satisfied with existing and traditional teaching 
strategies and was furthermore unaware of any innovations in other courses 
or situations. Few of the teaching faculty apparently saw the ExTFP as an 
opportunity for experimentation or deviation from the usual pattern. 

Although the teaching faculty did not, for the most part, use, develop, 
or observe innovative teaching strategies, they did find that the Fellows 
took an interest in the subject-matter of the courses that were being taught. 
Table XIII shows a tally of the teaching faculty's responses to a question 
asking about the Interest of the Fellows In the subject-matter of the 
courses. 
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FACULTY ASSESSMENT OF THE FELLOWS INTEREST IN 
THE SUBJECT- VATTER OF THE PROGRAM 



Did the Fellows seem 
genuinely Interested in 
the subject- matter of 
the program? 


Education 

Faculty 


Economics 

Faculty 


Econ.Educ. 

Faculty 


Total 


Definitely yes 


2 


3 


1 


6 


For the most part, yes. . 


4 


4 


2 


10 


For the most part, no . . 


0 


0 


0 


0 


Almost completely no . . 


0 


0 


0 


0 



Since the Fellows represented a relatively homogeneous group with 
particular interests and a common vocation/ it was hoped that the teaching 
faculty would consider the special needs of the Fellows and turn to them 
for enlightenment on the state of education at the elementary and secondary 
level and especially in inner-city poverty areas and rural poverty regions . 
Table XIV suggests the extent to which the teaching faculty made use of 
this opportunity. It is perhaps noteworthy that six out of ten of the teaching 
faculty members responded to the question in Table XIV indicating that they 
were uncertain or simply did not make use of the Fellows' background to 



enhance learning and develop theprogram. 



TABLE XIV 



UTILIZATION OF THE FELLOWS' EXPERIENCES AND BACKGROUND 





Was an effort made to 
utilize the experience 
and background of the 
participants to enhance 
the learning and develop 
the Program? 


Education 

Faculty 


Economics 

Faculty 


Econ.Educ. Total 

Faculty 


Yes 


4 


3 


3 


10 


No 


1 


0 


0 


1 


Uncertain 


1 


4 


0 


5 



Similarly, the Fsllows were of ths opinion that ths teaching faculty did 
not In many Instances nake use of or consider the background and pro- 
fessional experiences of the Fellows. Table XV Indicates the responses 



of the Fellows to a similar question. 



TABLE XV 

CONSIDERATION OF THE FELLOWS' EXPERIENCES AND BACKGROUND 



Did the program build on the 
participants' backgrounds and 
experiences, or did It seem to Ph.D. 

give no consideration to their 
backgrounds and experiences ? 


M . A . 


Total 


Consistently built on participants' 
background and experiences ... 2 


2 


4 


Usually built on participants' 
backgrounds : * * * 5 


6 


11 


Only rarely built on participants' 
backgrounds ; . 0 


5 


5 


Seemed to be unconcerned for 
participants' background 0 


1 


1 
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Cne additional question put to the Fellows to determine the extent 
to which the teaching faculty showed respect and utilized the Fellows' 
abilities and expertise. As suggested In the responses to the question 
found in Table XVT, a number of Fellows (23 percent) were of the opinion 
that the Fellows were only rarely treated as skilled professionals. The 
walls that separate the several educational divisions may indeed be 
difficult to penetrate . 



TABLE XVT 

FACULTY RESPECT AND UTILIZATION OF THE FELLOWS' 
ABTLTTY AND EXPERTISE 











Did the program faculty respect and 
utilize the Fellows' ability and ex- 
pertise ? 


Ph.D. 


' r .A. 


Total 


Consistently treated Fellows as 
skilled professionals with an abil- 
ity and knowledge to contribute 
to the learning process * 


3 


3 


6 


Usually treated Fellows as skilled 
professionals who could contribute 
to the learning process 


4 


5 


9 


Only rarely treated Fellows as 
skilled professionals who could 
contribute to the learning process: 
usually assumed they had nothing 
to contribute 


0 


6 


6 


Consistently assumed Fellows had 
nothing to con tribute to the learning 
process 


0 


0 


0 
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Although the teaching faculty may not have utilized the background 
and expertise of the Fellows to the extent that may have been desired, 
the Fellows found that the courses they took as part of the ExTF? compared 
quite favorably with courses that they had taken elsewhere. Although 
the record does Indicate that there were exceptions, generally the courses 
that were taken as part of the program were given a better than average 
rating by the Fellows . Table XVII, that consists of responses t.o three 
separate but related Questions, gives the rating of the several courses by 
the Fellows . 

It is perhaps not possible to draw any conclusive statements about 
the courses that wer included in the ExTFP from the data and responses 
noted in Table XVII, Generally, the Fellows seemed to find the 
courses to be as good or better than courses they had taken prior to 
participation in the ExTFP. There Is little indication, however, that 
the teaching faculty recognized the ExTFP as an unusual opportunity to 
experiment with new methods in their classrooms , methods that could have 
an Impact on education and the educational process sometime after the ter- 
mination of the ExTFP. Neither did the teaching faculty generally show 
a respect for the backgrounds of the Fellows or recognize their special 
needs. This failure to see the Implications of teaching beyond the immed- 
iate situation and the particular classroom perhaps substantiates the 
belief held by many critics that there exists a wall between higher educa- 
tion and elementary and secondary education and an additional wall be- 
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TABLE XVII 

FELLOWS' RATING OF COURSES 



A. Consider the best course you had Ln the 

program, and compare it to all other courses Ph.D. T/r .A. Total 

you have had anywhere . How good was it? 

The very best course I have ever taken 4 4 8 

Arong the top ten percent, but not the very best .3 9 12 

Better than average 0 1 1 

Below average 0 0 0 

Among the worst ten percent „ . . 0 0 0 

B. Now compare what you consider the worst 

course In the program with all others you have Ph.D. M.A. Total 

had. How bad was it? _ 

The very worst course I have ever taken 1 5 6 

Among the worst, ten percent. I 6 7 

Below average 3 3 5 

Better than average 2 0 2 

A nong the best ten percent I have ever had .... 0 0 0 

C. Now how would the rest of your courses In 

the ExTFP compare with the best and worst °h.D. A' . A . Total 

courses in the program? 

Almost all very close to the best 2 1 3 

Most fairly close to the best 4 6 10 

Spread evenly between, the best and the worst • • 1 7 8 

!' r ost fairly close to the worst 0 0 0 

Al most all very close to the worst 0 0 0 
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tween teacher education specialists and subject-matter specialists. 



A comment made by one of the economics Instructors in the ExTFP 
is perhaps significant. His comment was that "I had to provide their 
challenge by anticipating and formulating their needs." Perhaps few 
individuals, Including teachers themselves, have a clear idea of the 
problems involved in the learning process or what the alternative solu- 
tions to the problems or needs may be. Yet, the instruction in the 
several courses may have made a positive contribution to all of the 
individuals associated with the program. While all but one of the teach- 
ing faculty were of the opinion that the ExTFP resulted in making the 
Fellows "better scholars," the same Instructor who believed that he had 
to "provide their challenge , *’ commented also that "they not only learned 
more about content, they raised their sites r slcl on personal participation 
and Intellectual purpose." If indeed this was true, the courses probably 
provided a positive contribution to the total learning situation and helped 
the experienced teachers involved in the program to become better and 
more qualified professional educators. 

Practlcum experiences . The Ohio Council on Economic Education 
has as its primary goal service to the educational personnel employed in 
elementary and secondary schools in Ohio. The practlcum experience in- 
cluded in the ExTFP was looked upon as a means for providing additional 
services to several local communities and schools in the greater University 
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community. The practlcu n was a unique experience, not normally a part 
of the degree programs In economic education. Although It was a carefully 
planned experience Its effectiveness Is subject to different Interpretations 
by the several Individuals Involved In the i nple nentation and final 
assess nent. 

The co-authors of the proposal requesting support for the ExTFP 
recognized the need to give a careful description of the planned prac- 
ticum experiences. Although the proposal writers were not altogether 
convinced that a practlcu m experience would contribute significantly to 
the overall effectiveness of the ExTF p , great care was taken to Identify 
what was hoped would be an effective internship for the Fellows. 

The stated rationale of the practlcu m experience was 'll for the 
Fellows to combine economic theory and educational learning theories 
In an Internship, and ( 2 ) to strengthen OCEE-community relations by pro- 
viding an effective and special educational service to the cooperating 
schools. To accomplish this purpose the Fellows were expected to Q) 
inventory present social science curricula In the cooperating schools, 

(2) assist In the development of curriculum guides and materials, '3) re- 
late these materials to innovative materials and techniques developed 
as part of the national research projects in the social sciences, (4) teach 
experimental units whenever appropriate, f5) participate In final evalua- 
tion plans, and (& nake.use of these experiences whenever appropriate 
In the development of the required colloquium paper. 
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The director of the practician, and Instructor in the practicum. 
courses FcEd 690 which were offered over two quarters for a total of 
eight credits, was a faculty member of the Department of Economic Edu- 
cation and Director of College Programs with the OCEE. He was assisted 
by the OCEL's Director of School Relations. The administrative arrange- 
ments necessary to conduct the practlcum were made by these two staff 
members prior to the commencement of the practlcum in the Fall Quarter, 
lince some of the assignments were some distance from the University, 
a travel allowance was provided for teams of Fellows which enabled them 
to visit the cooperating school throughout the two quarters of the practicum. 

The Fellows were assigned to school systems in teams of three con- 
sisting of one Ph.D. Fellow, who served as the team leader, and two 
•\A.A. Fellows. In an attempt to assign the Fellows to appropriate school 
systems, each Fellow was asked to state his preferences as regards to 
grade level and type of school system, such as rural or urban. This in- 
formation was used to identify each Fellow's interests and in turn to assign 
him to an appropriate school. However, to avoid unnecessary competition 
for what could be considered the more desirable school systems, say those 
closest to the university, the Fellows were given a "Hobson's choice in 
regards to the actual assignment. Since the practicum director was at that 
time unfamiliar with the individual Fellows, he and the associate director 
of the program, who by late summer was well acquainted with each of the 
Fellows, collaborated to make the team assignments. The team assignments 
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were based upon (11 die expected compatibility of team members, (2) a 
balance of academic and leadership qualifications among the team mem- 
bers, (3' the nature of the preferences Indicated by the Individual Fellows, 
and (4) the major characteristics of the seven schools that had In fact 
agreed to cooperate with the practicu m experience. 

During the two quarters that the practicum was In operation there 
were no regularly scheduled classes. The total group did meet, however. 

In an opening orientation session and on a limited number of occasions 
throughout the two quarters to discuss matters of Interest to the entire 
group. Additionally the practicum director scheduled team meetings with 
the cooperating school personnel at which time the school district admini- 
strative personnel, the cooperating teaching personnel, and the Fellows net 
to define the objectives of the program. Additionally Individual teams met 
with the practicum director for about a one-hour session once per week. 

During the orientation session that was held during the first week 
of the Fall Quarter, all of the Fellows met with the practicum director. 

At this time they were informed of the team and school assignments, and 
were given a description of each school, information about the specific 
arrangements that had been made, and background Information of the 
cooperating school . 

The orientation session was followed by team meetings with the 
cooperating school personnel at which time the Fellows met with the school 
district administrative personnel, the cooperating teachers, and the 
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practicun director to define the objectives of the practician. Tn most 
instances, several additional meetings were scheduled during which time 
the groups tried to define further the objectives of the school district 
and decide how the objectives of the practicun could contribute to the 
attainment of common goals . 

Having defined the goals cf the practicu n, as the teams understood 
them, along with the goals and objectives for Improving instruction at the 
cooperating schools , the teams were requested to prepare and submit a 
contract for approval by the practlcum director and the practicun coordin- 
ator from the cooperating schools . In this contract the Fellows (1) described 
what they though could be accomplished in the period of two quarters 
scheduled for the practicun, ' 2 ) developed a statement of objectives, (3) 
described the goals of the school district to which they had been assigned, 
and ^4) indicated the specific steps or procedures they would follow to 
reach the goals they had established. Although the Fellows were given 
direction in determining what could and should be done In the various 
school situations, the practlcum was sufficiently flexible to allow for the 
different needs in the several schools. However, a number of common 
features among the various programs included (1) teacher orientation to 
the role of economics in the social science curriculum, (2) the develop- 
ment of specific materials for use in the classroom or a course of study 
for use in a district, and (3) methods for assuring follow-up activities 
once the practicu on team left the cooperating school. 
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A valuable by-product that occurred during the operation of the prac- 



ticum was the team arrangement which encouraged Interaction among the 



Fellows, particularly among the Ph.D. Fellow and the M.A. Fellows of 
a given team. Besides the planning that took place at the University and 
at the cooperating school, several of the teams spent time together In 
trips to and from the cooperating school. Although there were exceptions, 
the p h.D. Fellows worked closely with the V.A. Fellows In a team arrange- 
ment that encouraged positive Interaction. Again with some exception, 
a potential competitiveness, resentment, and clannishness that may have 
developed between the Ph.D. and '-'.A. Fellows did not occur, due perhaps 
in large part to the Intermingling of Fellows during the practicum. 

The ratings of the practicum by the Fellows as indicated in the 
responses to the practicum questionnaire were generally favorable; on the 
other hand, the external evaluator was highly critical of the practicum. 

For instance, in a personal letter to the associate director he commented 
that despLte the practicum director's "protestations , only one team did 
not make negative comments about the practicum." However, in this 
sas..e letter he added, "all liked the teaming Idea though." Further com- 
ments by the external evaluator appear In the written report found In 
Appendix B. Among other comments, the external evaluator noted In his 
report that "some questions were raised about the efforts of public school 
personnel involved in the administration of the practicum segment of the 



training enterprise.". 



At another point he commented that "severe criticism 
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TABLE XVIII 
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RATINGS OF THE PRACTICE < COURSES 



The practicum experience involved 
an opportunity cost to all individuals 
associated with it. The cost to each 
Fellow was a sacrifice of two regular 
courses (eight credit hours) . Given 
this cost, how do you rate the two 
practicum courses offered during the 
fall and winter quarters as an educa- 
tlonal experience as compared to; 

(1) the two courses you judge to have 
been most valuable to you 

(2) the two courses you judge to have 

been the least value to you 
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Based on the responses to the question 



found in Table XVUI, the 



two courses comprising the practicum experience were valued on the 



whole to be as favorable as the two most valuable courses in the ExTFP and 



by a rating of eighteen to three to compare more favorably than the two 
least valuable courses. The Fellows’ responses to several other questions 



in the practicum questionnaire were consistent with the responses to the 
entire questionnaire, which is found in Appendix E, and responses by the 
cooperating teachers found in Appendix F. Several of the questions which 
examine the overall effectiveness of the practicum have been reproduced in 
Table XIX along with the responses to similar or identical comments made 
by the practicum director and personnel in the cooperating schools. With 
some exceptions, the practicum experiences seemed to be overall an 
effective educational component of the ExTFP. 
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TABLE XIX 



OPINIONS OF THE PRACTICUM EXPERIENCE 



F = Fellows 
O = Practicum director 
C — Cooperating teachers 



SA = Strongly agree 
A = Agree 

? ss tt*. ^ ooicted 
D = Disagree 
SD = Strongly disagree 
NR - No response 







SA 


A 


? 


D 


SD 


_NR_ 


F 


The practicum was a beneficial 
experience 


7 


8 


5 


1 


0 


0 


D 


Practicum team members felt that 
the practicum was a beneficial 
experience 




1 










F 


The TJSOE should encourage prac- 
ticum experiences for programs 
similar to this program 


5 


8 


5 


2 


0 


1 


D 


(Identical comment) 






1 








F 


The practicum provided an effec- 
tive means for translating theory 
into practice 


5 


11 


2 


3 


0 


0 


D 


The practicum provided an excellent 
educational opportunity for the Fellows 




1 










F 


The practicum provided an effective 
means for translating theory Into 
practice 


5 


7 


4 


4 


1 


0 


D 


(Identical comment) 




1 










F 


Our tea m effort had or will have a 


7 


5 


6 


1 


1 


1 



definite impact on the social studies 
program of the cooperating school 

D Team effort had or will have a definite 
Impact on the social studies program 
of the cooperating school 
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TABLE XIX (continued) 



SA A ? D SD NR 



C The effort of the practlcum team will 9 9 6 2 1 1 

have a definite Impact on the social 
studies program of our school 



F Given opportunity costs , course work 4 4 4 8 1 0 

should have been substituted for the 
practlcum 

D Given the Fellows' opportunity cost, 1 

course work should have been substi- 
tuted for the practlcum 

F The number of actual hours (not course 0 0 2 17 2 0 

credit) spent for the practlcum was 
unreasonable 

D identical comment) l 

C The number of hours that I spent for 

the practlcum was unreasonable 0 2 3 12 11 0 



F A /y approach to curriculum design and 9 6 3 3 0 0 

change will be Influenced by my ex- 
periences In the practlcum 

C Vy approach to curriculum design and 2 21 2 3 0 0 

change will be Influenced by my ex- 
periences wlthlhe practlcum team 



F The material developed by the prac- 7 9 4 1 0 0 

ticum team are an Improvement over 
existing materials In the cooperating 
school 

D The materials developed by the prac- 1 

ticum teams are an Improvement over 
existing materials In the cooperating 
schools 
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of the practlcum was expressed; on the other hand, a somewhat unusual 
practlcum received generous praise.” (The "somewhat unusual practlcum" 
was a reference to a team assignment to an In-service graduate level 
course taught at a branch campus and under the immediate supervision 
of the practlcum director.) 

In a paragraph devoted to the practlcum experiences, the external 

evaluator noted in the written report that 

If the Intent of the practlcum was to provide a link between 
theory and practice, it experienced little success. Perhaps 
this result was to be expected, since remarks concerning 
the practlcum varied widely, ranging from 'excellent' to 'a 
wasted period of time.' It seems fair to state, on the basis 
of these interviews, that personnel operating at the site 
of the practlcum have considerable Influence on the quality 
of its learning potential. 

In a discussion of communication flows later in the written report, the 

external evaluator commented that 

Perhaps the major problem in this area stems from the prac- 
tlcum. Communication between the campus and the school, 
between Fellows and personnel active in the public schools , 
and among the Fellows working in a particular locale combine 
to place great demands for effective communication on all 
concerned . 

The impressions that the Fellows left with the external evaluator in 
regards to the practlcum do not appear to be altogether consistent with 
the responses made by the Fellows on the practicum questionnaire. The 
responses of the Fellows to the questions reproduced in Table XVIII 
suggest this Inconsistency. 
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In an attempt to clarify the apparent discrepancy between the 
responses of the Fellows to the questionnaire and the comments they had 
made to the external evaluator, conversations over the practicum experi- 
ences were held with several Individuals Including (1) five Fellows who 
were still on campus after the Spring Quarter, (2) the external evaluator 
via a gelephone conversation which was followed by a letter to the asso- 
ciate director, and (3) the practicum director. After Introducing the 
apparent contradiction, conversations centered around four potential 
factors that may have caused the discrepancy Including (11 the Fellows' 
greater honesty In responding to one form of questioning over another, 

( 2 ) the different perspective gained over time, (3) the effects of grades 
for the practicum courses which were not known at the time of the ques- 
tionnaire but were known by the time of the interviews wLth the external 
evaluator, and (4) possible preconceived ideas of practicum effectiveness 
held by the external evaluator prior to the interviews with the Fellows . 

In response to the first of the four possible explanations, the 
external evaluator suggested that the questionnaire asked different ques- 
tions and therefore elicited different responses from the questions asked 
during his interviews. In his follow-up letter, he commented, for instance, 
that "my lead-in on this section was in reference to the practicum as a 
link between research and practice. This aspect was suggested in your 
original proposal." The implication of this comment was that the question- 
naire did not raise questions directed toward this point and therefore the 
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the Fellows had been honest Ln their responses in both instances. 

The five Fellows maintained that They had been consistent under 
both forms of Questioning. The comments Ln the Questionnaire/ they sug- 
gested, asked generally if the practicum had provided a valuable edu- 
cational experience. To this question they responded in the affirmative 
and still could some three months after the practicum had been terminated. 
They went on to say, however, that the practicum was a beneficial educa- 
tional experience In that It helped them to understand how difficult It Is 
to change the curriculu m in an educational Institution; that while the 
practicum had not been effective, learning had In fact taken place. 

During the course of the conversation wLth the five Fellows, it 
became apparent that the Fellows believed that they had worked hard to 
make the practicu m a success, and that they had In fact experienced some 
success. They madeparticular note of the fact, however, that they were 
prevented from making greater success because of the poor cooperation 
received from the educational personnel in the cooperating schools who 
had volunteered to work with the practicum. In some Instances, joint 
meetings that had been planned with the Fellows and the cooperating 
teachers were not attended by the cooperating teachers even though these 
meetings were held In the cooperating school. When they were asked if 
the practicum would have been more successful if they had had greater 
cooperation from the cooperating teachers, they responded unanimously 
ln the affirmative. This response, however, did not coincide wLth the 
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response to similar questions in the practlcum questionnaires for either 
the Fellows, the practlcum director, or the cooperating teachers. Table 
XX indicates the responses to these related questions. 



TABLE XX 

ASSESSMENTS OF COOPERATION DURING THE PRACTICE' 



F = Fellows 
D Practlcum director 
C = Cooperating teachers 



F Personnel In the cooperating schools 
were apprehensive of the team visits 
at first 

C I was apprehens Ive of the tea m 
visits at first 



SA = Strongly agree 
A = Agree 
? = Undecided 
D = Disagree 
SD - Strongly disagree 
NR = No response 

SA A ? D SD NR 

1 10 2 7 I 0 



3 4 4 7 7 3 



F Personnel In the cooperating schools 7 10 3 0 1 0 

appreciated the team's efforts by the 
end of the experience 

C T appreciated the practlcum team's 13 9 3 2 1 0 

efforts by the end of the experience 

F Personnel In the cooperating school 6 12 0 2 1 0 

were generally cooperative 

D ^Identical comment) 1 



Despite the generally favorable comments about the cooperation 
that existed between the Fellows and the personnel in the cooperating 
schools, as Indicated In the responses recorded In Table XX, the five 
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Fellows Indicated that the practlcum experience would have been con- 
siderably riore effective if greater cooperation had been evident. This 
response was consistent with an assessment of a practlcum experience 
by an V A. Fellow whose team effort, despite the high-quality of the 
team, was considered to be one of the least effective. This Fellow, who 
was also one of the five interviewed in June, had reported in April that 
in order for a practlcum to be successful "a real committment r slc] must be 
obtained from the administration of the School District, 'luch a committment 
consists of time to provide leadership in directing and coordinating such 
a project as well as noney to free teachers so that they can work on the 
effort without having to perform a full-time job, too." A copy of the com- 
plete report by this Fellow is found in Appendix G. 

The responses by the five Fellows to the first consideration helped 
to clarify the second factor under consideration, viz . , that time had given 
a different perspective. The time factor according to the five Fellows, 
had not caused a change in attitude, and essentially, the responses to 
-the-que stlonna 1 re 5 ndLth argues tions asked by the external e valuator were 
both correct and correct over time. 

Grades apparently had little effect on the Fellows . Any hypothesis 
that grades caused a change in the Fellows’ attitudes was unsubstantiated 
according to the five Fellows since many of the Fellows had been given 
a grade of "A" for either one or both of the quarters in which they were 
enrolled in thepractlcum. No grades of "B" were issued; those Fellows 
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who were not Issued a grade of "A" for both of the quarters were Issued 
a "Cr” (credit^ for one of the quarters. Only one of the Fellows was 
given a "Or" for both quarters; he had not been Interviewed by the 
external evaluator. 

The five Fellows agreed that the external evaluator did have pre- 
conceived Ideas about practicum experiences before he began the Inter- 
views with the Fellows: this charge was not denied by the external eval- 
uator. The five Fellows maintained, however, that despite any bias 
that the external evaluator nay have had toward practlcum experiences, his 
bias did not lead him to misinterpretations of their responses. His report 
essentially reflected their responses to the questions he had asked, and 
furthermore, his questions had been direct and fair. Likewise, the external 
evaluator maintained, that despite any bias he may have held, his ques- 
tions were objective and focused "on the practicum Itself." The negative 
criticisms of the practlcum that were stated In the final written report 
represented an objective and accurate summary of the statements made by 
the Fellows during the" interviews”. ' — • — * — — — — 

Several comments made during a discussion with the oractlcum 
director may help to clarify some of the attitudes expressed toward the 
practlcum experiences. The external evaluator had In fact commented about 
one practlcum that had received "generous praise." At least two practlcum 
experiences had been failures even though "negative" learning may have 
occurred. There were, however, several teams somewhere between these 
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extremes that had apparently experienced some success. For Instance, 
three school systems that cooperated with the practlcum had scheduled 
new courses In economics to be offered for the first time subsequent to 
the practlcum. As one criterion for measuring the success of the prac- 
ticum, these additions to the social science curricula in these schools 
deserve some consideration in the total assessment. In another Instance, 
one of the teams had been assigned to a high school where the team's 
efforts had not produced an effective relationship with the cooperating 
personnel and where there was little evidence of success. The practl- 
cum was helpful, however, in the planning and Implementation of a sum- 
mer cooperative school program sponsored by the OCEE and the N3Ffcr 
educational personnel In this school during the summer following the ExTF D . 

In conclusion, it may be difficult at this time to assess the effect- 
iveness of the practlcum experiences. It has been said by John Coleman, 
President, Haverford College, and others that "Changing a curriculum has 
all the practical and emotional Implications of moving a graveyard." 
-Perhaps the-memibers-of-the-teamis -that'-did mot- experience suc'ces s learned 
the truth of this statement and they may as a result of their practlcu m 
experiences be better prepared to know how to go about this grave task 
at another time, in other Instances, where the immediate successes were 
not apparent, the positive affects of the practlcum may become evident 
at some later date. For the present, a number of Insights were perhaps 
gained from the practlcum experiences that may lead to corrective mea- 
sures in future planning. With these corrections, the practlcum experience 
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Is perhaps worthy of replication. 



Group Process and Group Interaction . The special, non-credit group 
process experiences included In the ExtFP were developed In cooperation 
with two members of the Department of Guidance, Counseling and Student 
personnel, College of Education, and designed primarily to provide M 
experience in group process methods, (2) group and Individual orientation 
and initial awareness of the personal meanings helpful for Fellows involved 
in a year of rigorous, academic pursuit, and (3^ a systemic program to 
reduce anxieties and enhance the learning potential of the Individual Fellows 

Additionally, it was the purpose of the non-credit group process 
sessions to create a positive group splrti and establish solidarity among 
the Fellows. The Importance of maintaining group spirit and solidarity was 
recognized by the program directors through past experiences with special 
educational programs and through a recognition that resentments could 
develop among different groups as, for instance, the Ph.D. and the **.A. 
Fellows . 

Maintaining group-spirit and group-solidarity became ihe-Eesponsiblllty x _. 
of (l! the co-directors of the group process sessions and (2) the associate 
director of the ExTFP. As originally conceived, the group process sessions 
were intended to encourage positive interaction among the Fellows; the 
program's associate director was expected to advise individual Fellows 
on an Informal, day-to-day basis . 

The special group process experiences were considered to be an 



166 



156 





o 

O 

ERiC 



integral part of the ExTFP and were "ade mandatory for all of the Fel- 
lows. The co-directors who conducted the group process experiences 
were under separate contract through arrangements made by the pro- 
gram director and under the terms of the ExTFP budget. 

Incorporating the group process experience into the ExTFP was 
In no small part Influenced by the emphasis placed on group process 
experiences by the USOE administration. Specifically, the then pro- 
posed director had been invited to attend the Invitational Meeting on 
the Reparation of Administrators , Counselors, and Teachers (IMPACT) 
held in Phoenix, Arizona, April 27- 1 '- ,T ay 2, 1968. The emphasis of these 
sessions was on group process; the sessions were attended by the dir- 
ectors and previous directors of special programs supported through the 
U80E. The program designed for the Fellows in the ExTF D was a direct 
outgrowth of these sessions. One of th& co-directors for the ExTFP group 
process sessions had served as a faculty member for IMPACT. The con- 
tent and methods to be employed in the special group process sessions 
were to-follow the content and techniques used in-the group process 
meetings held in conjunction with the Phoenix Institute. Both co-direct- 
ors were professionally prepared to conduct the sessions since both had 
been trained in the techniques of group process and had considerable 
experience in this work. 

The co-directors recommended that the group process sessions 
follow, rather than precede, the first quarter of academic work, i.e. that 



167 



157 



( 



0 



o 

ERIC 



the initial session be held sometime between the introductory "umrner 
Quarter and the Fall Quarter. They recommended further that follow-up 
sessions be planned for later in the year. Therefore, the special non- 
credit group process experiences were scheduled to consist of (1' a 
ten dayintensifled session from September 12-22, 1969, and ( 2 ) follow- 
up sessions to be conducted during the remaining three quarters of the 
program. The participants were to determine the exact number of follow- 
up meetings, but It was anticipated that at least two sessions would be 
conducted during each of the three remaining quarters, consequently in- 
volving the group for fifteen or more days . 

A feeling of apprehension over the planned sessions and some ill- 
will developed among the Fellows before the group process sessions 
ever began. These apprehensions may perhaps be attributed to at least 
three causes. First, the Fellows were informed of the nature of the group 
process sessions by the director and the associate director of the ExTFP 
during the summer preceding the first scheduled group process session. 

By this time the director and associate- director had participated in group 
process sessions and on several occassions they apparently conveyed 
a feeling of Indifference toward group process methods. The attitude 
that was left with the Fellows should not be construed to imply a com- 
pletely negative feeling toward group process techniques, and especially 
not toward the proposed sessions planned for the Fellows. Rather, the pro- 
gram director and associate director seemed to suggest that they had not 
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been greatly impressed with their experiences with group process but recog- 
nized that others probably were and that the Fellows might be . 

Second , the Fellows had some misgivings over the require ment 
to return to the campus by September 12, since a number of them plan- 
ned to return to their home towns during the interval between the Summer 
Quarter and the beginning of the Fall Quarter. As a compromise to 
several requests for starting at a later date, the initial session was 
scheduled for September 15. 

Finally, the Fellows became apprehensive over the co-directors 
when they first met them during the last week of the summer term in a 
special, but brief, orientation session. This session was held immediate- 
ly following a three hour afternoon class in economics taught by an 
instructor who lectured rapidly and with minimum group interaction. In 
contrast, the group process co-directors were soft-spoken and commun- 
icated with the Fellows in response to specific questions they were asked. 

Any suspicions and apprehensions that the Fellows may have held 

toward~grbulTpr^es'sihg--seerned--confrrmed“ln-this- initial meetlngwlththe...... 

co-directors. Among other things, the co-directors were candid in any 
responses they made to the questions raised by the Fellows. In one in- 
stance, for example, one Fellow asked why the group process sessions 
had been made part of the ExTFP. In responding to this query, one of the 
co-directors commented "First, the U.S. Office of Education wants it. . . . 

The techniques employed by the co-directors during the orientation 
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session were appropriate In that the co-dlrectors were suggesting In ef- 
fect that Individuals should be honest with other Individuals and should 
not conceal their real feelings. To the Fellows, who were basically un- 
familiar with group process techniques and who had been made appre- 
hensive of these techniques In the discussions they had had, this 
honesty, brevity, and "soft" approach seemed to arouse their suspi- 
cions further and probably Instilled an element of fear as well. 

when the Fellows met in September for their first session, they 
were randomly divided Into three groups. One group met with the co- 
directors together; each of the other groups met with one or the other 
co-dlrector separately. Although the sessions had originally been 
scheduled for September 12-22, 1969, they were actually held from Sep- 
tember 15-20. Meetings usually lasted between two and three hours with 
the time schedule staggered so that the co-dlrectors could meet with 
their respective groups throughout the day. 

As reported by the external evaluator, the group process sessions 
were sim ply "allowed to fade out." App arently the Fellows were unwilling 
and unprepared to spend additional time in non-credit group process ses- 
sions in the face of other pressing obligations. As diagnosed by one 
of the co-dlrectors, the Fellows seemed to place a higher priority on their 
studies while plans for follow-up sessions "fell through because of sche- 
dule problems, unexpected obligations, riots, and what-not." Although the 
co-dlrectors continued to work on an individual basis with several of the 
Fellows, group process as such was discontinued early In the year. 
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Tn an effort to measure the effectiveness of the group process 
sessions that had been held in September, the Fellows were asked early 
In October to respond to an eleven-item questionnaire prepared by the 
associate director in cooperation with group process co-directors. Tn the 
questionnaires, the Fellows were asked whether they agreed or disagreed 
with a statement and were further asked to comment on the statement. 
These responses were considered significant because (IT they give some 
indication of the characteristics of the Fellows and (2) they suggest 
something of the effectiveness of the group process experiences. Several 
of the comments and representative responses have therefore been included 
in the study and may be found in Appendix D. 

An examination of the representative responses to the questionnaire 
points to the apprehensions that were initially held by the members of the 
group, but also to the progress that was made toward better group inter- 
action during these early sessions. Despite the apparent changes in 
attitude, however, several Individuals did not attend the final sessions 
of the first week: later attempts to get the group together were generally 
futile. For the most part, the Fellows did not seem to want to schedule 
time for additional group process sessions and the co-directors were 
unable to arrange a time that was mutually satisfactory. 

Although the formal sessions in group process were discontinued, the 
co-directors provided consultation services for a number of the Fellows. 
With one individual, sessions continued throughout the academic year. 
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tncluding several sessions that lasted between two and three hours each. 
Additionally, however, many of the Fellows looked to the program director 
and associate director for a variety of services Including advice and 
counsel. 

Since the group process sessions as such "faded out," it was 
difficult to discern what long-run consequences, if any, these sessions 
produced on the Fellows . Responses made to questions asked In the 
final questionnaires did, however, give some indication of how the group 
interacted during the year. Competition for grades or prestige among the 
Fellows, for instance, may have stifled interaction. Table XXT suggests 
that competition did not inhibit interaction but was overall a positive factor. 



TA BLE XXT 

THE FELLOWS’ OPINIONS OF THE EFFECTS OF COMPETITION 



How did the level of competition 
affect your ability to benefit from 
the program? 


Ph.D. 

Fellows 


M.A. 

Fellows 


Total 


Very beneficial: stimulated to 
achieve my maximum potential . . 


2 


1 


3 


Probably good: sometimes pushed 
me to greater efforts 


4 


9 


13 


Had no noticeable effect on me . . 


1 


4 


5 


Sometimes interferred with learning 


0 


0 


0 


Was extremely disruptive* grades rather 
than learning became the goal. . . 0 


0 


0 
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fn response to a second and related question, two Fellows found 
the level of competition to be "somewhat disruptive." Table XXII in- 
dicates a slight shift in the opinions of the Fellows when asked about 
the effects of competition on the group. 



TABLE XXII 

THE FELLOWS’ OPINIONS OF THE EFFECTS OF COMPETITION 

ON THE GROUP 



How did the level of competition 
in the program see'" to affect the 
Fellows as a group? 


Ph.D. 

Fellows 


M . A . 

Fellows 


Total 


Very beneficial: almost all have 
been stimulated to achieve their 
maximum, potential . 


1 


2 


3 


Probably good: many seemed pushed 
to greater efforts 


5 


4 


9 


No noticeable effects 


1 


6 


7 


Somewhat distruptive: some people 
became too tense, tried too hard for 
grades or recognition 


0 


2 


2 


Very disruptive: grades or recog- 
nition rather than learning became 
the goal 


0 


0 


0 



O 

ERIC 



En bloc programming has the potential to encourage individuals to 
interact with one another. Some individuals, of course, are more willing 
to interact with others regardless of the situation. The Fellows in many 
instances interacted well and without regards to differences in age, degree 
program, sex, or racial origin. Several Instances may be cited, for 
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example, where Ph.D. Fellows provided assistance to the W.A. Fellows 
and did so despite the academic pressures they themselves were under. 
There were on the other hand, exceptions. One Ph.D. Fellow commented 
at the close of the program that his own schedule was demanding and 
that he had not made himself available to others who may have wished 
assistance with their studies. Table XXIII gives some indication of how 
and to what extent the Fellows interacted with one another during the 
course of the program. 



( ) 



(...) 



TABLE XXIT.I 



THE FELLOWS’ OPINIONS ON THE EXTENT AND NATURE OF 
GROUP INTERACTION 



Describe how the ExTFP Fellows 
typically interacted with one an- Ph.D. 

other during the year? Fellows 


M.A. 

Fellows 


Total 


Almost all of the Fellows studied 
together as a group, cooperated and 
shared ideas 1 


0 


1 


Fellows tended to work and study 
together in clearly defined sub-groups; 
persons in different sub-groups were 
usually congenial to one another . 5 


12 


17 


Fellows tended to work and study 
together in clearly defined sub-groups , 
but persons from different sub-groups 
were often hostile to one another . 0 


0 


0 


Fellows tended for the most part to go 
their own ways and worked alone or 
with one or two friends 1 


n 

£ 


3 


Fellows competed with each other and 
were unwilling to help others or share 
ideas 0 


0 


0 
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To gain a perspective on the influence of the Interaction that was 
evident among the Fellows, the teaching faculty was asked to respond to 
a question that asked if working and studying In groups had produced bene- 
ficial results. The faculty responses, which were generally favorable on 
this topic, are indicated in Table XXIV, 



TABLE XXIV 

THE FACULTY'S OPINIONS OF THE BENEFITS OF GROUP STUDY 



In your opinion, has the 
fact that the Experienced 

Teacher Fellowship parti- Education Economics Econ.Educ. Total 



cipants studied and worked 
as a group resulted in more 
satisfactory results ? 


Faculty 


Faculty 


Faculty 




Yes , use of group resulted in 
greatly enhanced learning. . . 


. 4 


3 


2 


9 


Perhaps , group effect was 
noticeable 


2 


2 


1 


5 


Doubtful, group effect was 
useful in enhanced learning. . 


0 


2 


0 


2 


No, group effect did not 
contribute to learning .... 


0 


0 


0 


0 




Because of the en bloc programming, the Fellows had ample oppor- 
tunity to work and study together. According to the responses of the Fellows 
to the question found in Table XXIII, many of the Fellows used this oppor- 
tunity to interact positively with one another throughout the program. For 
the most part, the interaction that resulted from working and studying to- 
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gether helped to establish a positive group spirit and a feeling of Identity. 
Table XXV indicates the opinions of the Fellows toward group spirit and 
identity. 



TABLE XXV 

THE FELLOWS' OPINIONS OF GROUP SPIRIT AND IDENTITY 

AMONG THE FELLOWS 



Wa3 there a felling of group spirit 
and group identity among the Fellows 
in the program? 


Ph.D. 

Fellows 


M.A. 

Fellows 


Total 


Yes , there was a strong feeling of 
group spirit and identity 


4 


5 


9 


There was a moderate feeling of 
group spirit and Identity 


3 


5 


8 


There was some, but not too much 
feeling of group spirit and identity. 


0 


3 


3 


There was no appreciable feeling of 
group spirit and identity 


0 


1 


1 



Tn response to a related question, the faculty was generally of the 
opinion that the Fellows gave evidence of group solidarity. Table XXVI 
gives an indication of the opinions held by the faculty on this matter. 

To assess the level of morale of the Fellows, the Fellows and the 
teaching faculty were asked to comment on the matter of morale tn their 
respective questionnaires. Table XXVII gives indication of the responses 
to questions pertaining to morale, responses that overall Indicated high 



morale during the year. 
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TABLE XXVI 



THE FACULTY'S APPRAISAL OF GROUP SOLIDARITY 



Was there a feeling of 
group solidarity among 
the participants in the 
progra m ? 


Education 

Faculty 


Economics 

Faculty 


Econ.Educ. 

Faculty 


Total 


ves, there was a strong 
feeling of group solidarity 


1 


2 


2 


5 


There was considerable 
feeling of group solidarity 


5 


4 


0 


9 


There was some, but not 
much , feeling of group 
solidarity 


0 


1 


1 


2 


There was no feeling of 
solidarity at all .... 


0 


0 


0 


0 



TABLE XXVII 



RATINGS OF THE FELLOWS’ MORALE DURING THE Ml 



Fellows' 

own morale | 

Rated by , 


Fellows' overall or 
Group morale 
Rated by 

— TT ‘ U’H 


Ph.D. 


M.A. 1 


Ph.D. 

j 


tauc . 
M.A. Faculty 


CiUOIl. 

Faculty 


Faculty 




Very high 2 


5 1 


1 

3 


4 2 


0 


1 


10 


Pretty high 5 


5 


4 


7 3 


5 


2 


21 


About average 0 


3 


0 


1 1 


2 


0 


4 


Pretty low 0 


1 


! 0 

j- 


2 0 


0 


0 


2 


Very low 0 


0 


1! ° 


0 0 


0 


0 


0 
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Based on the opinions of the Fellows and the faculty to the several 
questions related to group interaction, esprit de corps, competition, and 
solidarity, there was apparently little hostility among the Fellows and 
considerable evidence of cooperation and congeniality. For the most 
part, there were positive benefits derived through the interaction that 
occurred. Several factors may account for the overall high level of morale 
and positive interaction including (1) the care taken In the selection of 
participants, (2) special group activities such as the practicum and the 
group process sessions, (3) the interaction that occurred during the en 
bloc classes and the informal activities conducted outside the regular 
program, and (4) the overall positive attitude of the Fellows that resulted 

fro m the opportunity to spend a year away fronn the routine of the class- 

i 

room coupled with the opportunity to establish new friendships in a new 

i 

environment. Perhaps all of these factors contributed to ; the overall high 
morale and positive attitudes. • j 

Shortly after the conclusion of the September group process sessions, 
one of the group process co-directors commented to the 'associate director 

of the ExTFP that the Fellows represented a "potentially explosive group." 

.1 

Although this assessment may have been correct, the Fej.lows, as indicated 
by their responses to several questions on this topic, generally maintained 
a positive attitude, high morale, and a strong sense of identity and 
solidarity throughout the year. 



ERjt 



178 



168 



Communication flows and relationships . The administration of a 
special, full-year program for experienced teachers from both elementary 
and secondary schools involved in a rigorous academic program in a 
college situation is difficult under ideal conditions . As suggested by 
Donald Bigelow, the difficulty is compounded when It is realized that 
teachere education has often been a neglected area In institutions of higher 
education and that the members of the "high church" often fail to ap- 
preciate the day-to-day problems that face teachers employed in the edu- 
cational "ghetto." Finally, teachers who take the opportunity to continue 
their own education on a full-time basis need to take up residency in a 
strange community and need to make the decision as to whether to move 
their families with them or try to commute on weekends or during long 
vacations when weekend commuting is not possible. 

Recognizing that the Fellows selected to participate in the ExTFP 
would need to adjust to the community and the University and would need 
to establish relationships with the other Fellows, the teaching faculty, 
and the program administrators, plans were made to ease the adjustment. 

To that end, the group process sessions and Individual counseling by the 
co-directors of the group processing sessions were included in the program. 
This component of the program was directed toward providing assistance 
with academic and personal problems that the Fellows might have. Addition- 
ally, the program director and associate director took direct responsibility 
for maintaining communication flows and relationships among the Fellows 
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and with the several other Individuals involved directly and indirectly 
with the program. 

The role of the associate director of the program was especially 
important to maintaining communication flows and relationships. Among 
other duties, the associate director served as a principal advisor and 
ombudsman to the Fellows, immediate liaison to the director, associate 
instructor in the economic education courses, and the coordinator of 
activities. Previous experiences with special programs for experienced 
teachers and a full-time faculty position were vital credentials in carrying 
out the responsibilities entrusted to the associate director. 

Based on previous experiences with special teacher programs, it 
was planned that the program director should not be readily accessible to 
the Fellows, but that the Fellows should try first to resolve any problems 
or conflicts through discussions with the associate director. This arrange- 
ment was considered to be prudent since individuals , especially in a new 
environment, often have questions and conflicts they wish to discuss with 
someone who is familiar with an institution and is in a position to act. 

In a special program, such as the ExTFP, these same individuals are often 
reluctant to take what may be a relatively minor problem to the program 
director. To maintain close and cordial relationships with the program 
director, however, the Fellows were encouraged to discuss academic matters 
and items of group Interest with the director during the regularly scheduled 
class sessions that were held throughout the year; not uncommonly, 
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causeries ensued during class breaks, after classes, and on other Informal 
occasions . 

The associate director, meanwhile, was readily accessible to the 
Fellows and they often discussed matters with the associate director 
before making an appointment to see the director when an appointment 
seemed necessary. As was Intended, formal conferences with the director 
were often by appointment and not uncommonly based upon the recommenda- 
tion of the associate director. On the other hand, the program director 
was never remote, and because the arrangements were flexible, the pro- 
gram director was reached directly in several instances. Additionally, 
the program director served as the advisor in economics and economic 
education to several of the Ph.D. Fellows, and In this capacity, these 
Fellows had ready access to the director. 

Figure 10 suggests the administrative arrangements that were made 
to facilitate communication flows and maintain relations with all of the 
Individuals involved with the program. 

As suggested In Figure 10, the Fellows had immediate access to the 
associate director as indicated by the double lines that connect the Fellows 
and the associate director. The Fellows turned to the associate director 
for general information and advice concerning registration, course work 
and demands, the colloquium paper, and other sundry matters. 

As indicated by the double lines that connect the director and the 
associate director, the program administrators worked In a synergetic 
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FIGURE 10 

COMMUNICATION FLOWS AND RELATIONSHIPS 



relationship on all matters pertaining to the ExTFP. Although the director 
and the associate director had particular functions* there was never a 
careful distinction drawn to separate individual duties. The director and 
the associate director sometimes acted in concert and sometimes indivi- 
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dually on a number of natters during the planning and implementation 
stage and that Involved the many individuals who worked with the pro- 
gram. This flexible approach was made possible through a mature re- 
lationship between the director and associate director based upon a 
mutual feeling of loyalty and respect. 

Both the director and the associate director maintained direct 
communication with the several individuals indicated on the right in 
Figure 10. The director, however, was more immediately respons ible for 
matters pertaining to the grant budget and for maintaining communications 
and relationships with University budgetary officers, the central 
administrative staff, and the college deans. 

Making arrangements for an en bloc course for the twenty-one Fellows 
through the College of Education may be cited as an example of the working 
relationship that existed between the director and the associate director 
and between these two individuals and the teaching faculty and administra- 
tive officers . The program director made inquiry to arrange an en bloc 
course for the Fellows via a phone discussion with the assistant dean of 
the College of Education. Included in the arrangements that were made 
was the identification »f a course instructor who had been recommended to 
the director t r the associate director. Later the associate director met 
with the course Instructor to discuss the nature <*f the program and the 
major characteristics of the participating Fellows . During the course of 
this disucsslon, the associate director noted the desirability of avoiding 
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unnecessary competition between the Ph.D. and the ^'.A. Fellows since 
several of the Ph.D. Fellows were already conversant in the subject- 
matter of the course, whereas many of the M.A. Fellows were not. The 
instructor basically dismissed this point and commented that he had found 
few differences between Ph.D. and M.A. candidates and did not expect 
to find a difference with this group. Tn a follow-up conversation near the 
end of the course, the instructor said that he had Indeed found some dif- 
ferences and inquired at this time if any special grading procedures had 
been established with the Fellows . He was informed that generally there 
had been no special arrangements made, and although alternatives were 
suggested, no recommendations were made. However, upon consideration 
of the nature of the program, the nature of the subject-matter, and the 
diversity in academic preparation among the Fellows, he issued grades 
of "Cr" (credit) to two Fellows who, despite hard work, had not achieved 
acceptable graduate grades. While the associate director maintained the 
communications with this instructor, the director took the respons iblity 
for making the necessary, and in this instance, difficult, budgetary 
arrangements for supporting the en bloc procedure that had been followed 
for this course . 

In examining the effectiveness of the program administration, the 
external evaluator found that the "interviewees were consistent in their 
praise of work done by the director and the associate director." He noted 
further that the "participants were appreciative of the availability of the 
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associate director's time and attention. 'Very accessible' was a common 
response." In further support of the effectiveness of the program admini- 
stration, one ,/r .A. Fellow commented in a letter to the associate director 
several weeks after the program had terminated that "I want to thank you 
very much for the many kind things that you did for me. You might not 
have been aware of them, but it was such things that kept me together. . . . 
If it weren't for you, T. don't know how I would have made out." Another 
"' 4 .A. Fellow, a potentially militant student, commented similarly in a 
letter sent to the associate director that " . . .you guys r the director and 
the associate director! are two of the nicest people that I or any one else 
can ever hope to work with or under. For one thing, you were concerned 
with problems, more specifically, human problems, and those things that 
affected the group o.r an individual within the group affected you with the 
same impact." 

In the final questionnaire, the Fellows were asked a series of 
questions that asked them about problems they may have encountered 
during the year. The responses to the first question in this series gives 
further Indication of effectiveness of the program administration. The 
question and the responses, found in Table XXVT.II, indicate that a majority 
of the Fellows found that problems and dissatisfactions did not interfere 
with program effectiveness and that they were at most Irritating and 
inconsequential. 
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TABLE XXVTII 

THE SEVERITY OF PROBLEMS AND DIS SATISFACTIONS 



In any program such as this, some 
problems and dissatisfactions are 
inevitable. How seriously did .the 
problems you encountered interfere 
with the program’s potential worth 
and effectiveness ? 


Ph.D. 

Fellows 


M.A. 

Fellows 


Total 


Extremely seriously 


0 


0 


0 


Moderately 


1 


1 


2 


Somewhat 


0 


1 


2 


"lightly 


2 


2 


4 


Not at all — they were at most 
irritating but inconsequential . . . 


4 


10 


14 



A question that appeared later in the series asked the Fellows to 
identify the individual or combination of individuals who resolved problems 
that were resolved. Since sixteen of the Fellows found that problems and 
dissatisfactions interfered only slightly or were inconsequential to program 
effectiveness, it may have been difficult to identify the individuals who 
resolved problems. Yet, it was perhaps the individuals identified in their 
responses who helped to keep potential problems at an inconsequential 
level. Table XXIX indicates the responses of the Fellows to this question 
and shows that in many Instances the associate director and the director 
helped to resolve the problems that did develop. The pattern of responses 
to the question in Table XXEX provides a good fit to program intents. 
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TABLE XXIX 

AN IDENTIFICATION OF THE INDIVIDUALS RESPONSIBLE 
FOR SOLVING PROBLEMS 





Who was most often responsible 
for resolving problems that were 
resolved ? 


Ph.D. 

Fellows 


M.A. 

Fellows 


Total 



Director 


0 


0 


0 


Associate director ....... 


2 


8 


10 


Faculty members 


1 


0 


1 


Fellows 


1 


0 


1 


A combination of two or more of the above 
'please specify! 






(Director and Associate Director! . 


4 


1 


5 


(Assoc. Director and Fellows) . . 


0 


2 


2 


^Assoc. Director and Faculty) . . 


0 


1 


1 


(Other) 


0 


0 


0 


(No response) 


0 


1 


1 



To assess the effectiveness of the division of labor between the 
director and the associate director, as perceived by the Fellows, the 
Fellows were asked to respond to a question that has been reproduced in 
Table XXX. 

O 
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TABLE XXX 

THE FELLOWS' ASSESSMENT OF THE EFFECTIVENESS OF THE DIVISION 
OF LABOR BETWEEN THE DIRECTOR AND THE ASSOCIATE DIRECTOR 





How would you describe the effec- 
tiveness of the division of labor 
between the director and the asso- 
ciate director? 


Ph.D. 

Fellows 


M.A. 

Fellows 


Total 



Very effective 


5 


5 


10 


Effective 


2 


7 


9 


Slightly effective 


0 


2 


2 


A detriment to progra n effectiveness . 


0 


0 


0 



Although two of the M.A. Fellows were of the opinion that the divi- 
sion of labor between the director and the associate director was only 
slightly effective, the Fellows generally substantiated in their responses 
to the question in Table XXX the opinions of the director, the associate 
director, and the external evaluator that the director and the associate 
director worked effectively together on the various aspects of the program. 

In maintaining communication flows and relations among the various 
individuals Involved in the program, it is noteworthy that several of the 
Ph.D. candidates performed an excellent service to the i^.A. candidates 
and to the program generally. The external evaluator found that "within 
the group participants, it was apparent that the Ph.D. candidates had 
provided strong leadership along with both Intellectual and psychic support. 
There were evidently numberous opportunities for Informal exchanges, 
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although a small ninority may have been at a disadvantage here." In 
support of the comments made by the external evaluator, the Ph.D. candi- 
dates were observed on numerous occasions to assist the M.A. candi- 
dates, especially with their courses in economics. Already during the 
summer introductory economics courses that were mandatory for the M.A. 
candidates, the Ph.D. candidates made themselves available and provided 
considerable assistance to those Fellows who were unfamiliar with eco- 
nomics, mathematics, and the general orientation of the professional 
economist. Even in those courses, such as educational statistics, which 
all of the Fellows attended en bloc, there were no conplaints voiced over 
competition among the Fellows; in fact, many of the Ph.D. Fellows provided 
helpful assistance rather than competition. Although the mixture of M.A. 
and Ph.D. Fellows may have been a source of irritation and trouble, there 
was little evidence throughout the program of any serious conflict. 

Perhaps the major weakness in the communication flows and relation- 
ships among the several individuals involved in the program was the 
failure to establish effective communications among the teaching faculty, 
the director of the practicum, and the co-directors of the group process 
experiences. While there was at least some communication among the 
members of the teaching faculty within a department, there was little 
evidence of inter-departmental or inter-collegiate communication; i.e., 
exclusive of the director and associate director. Similarly, there was only 
minimal evidence of communications of the members of the teaching faculty 
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with the director of the practicing or of any of these individuals with the 



co-directors of the group process experiences. 

Some evidence of the lack of communication among the several 
individuals involved in the ExTFP may be gathered via an observation of 
the comments , and lack of comments , to the final question on the faculty 
questionnaire, an open-ended question, that asked the teaching faculty 
to . .note any features of the program which, in your opinion, contri- 
buted significantly to what happened during the year." Three individuals 
made no concluding comments. One individual commented that "I know 
very little about the program as a whole. . . another commented that 
"My participation was quite limited. ..." These latter responses were 
made by individuals who had taught en bloc courses. 

In conclusion, the relationships that connected the Fellows, the 
director and the associate director, and the several other Individuals in- 
volved in the program were generally effective. Similarly, the relationship 
that existed between the director and the associate director was effective. 
There was evidence, however, of a lack of effective communication among 
the members of the teaching faculty and of the teaching faculty as a whole 
with the director of the practicum and the co-directors of the group pro- 
cess experience. 
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IV OUTCOMES 



Measure merits of cognitive and attitude changes. Although the 
scores made on standardized tests provide a neasure of achievement and 
change and a means for comparison, the results must be interpreted 
against existing conditions and in perspective, it would be Inappropriate, 
for Instance, to iudge the worth of a full-year program or the achievement 
of the experi mental population solely on the changes that may be evident 
through an analysis of the scores on a particular testing instrument. In 
comparing one program or population with another, for example, an 
observer may remonstrate that percentage gains are small even when the 
analysis reveals that the scores are statistically significant. 

As was anticipated, the Fellows, with some exception, gave evi- 
dence of significant changes In their general comprehension of economic 
terms, concepts, and generalizations as measured against the several 
instruments that were admlnisteied to measure these changes. Although 
statistically significant differences were observed between the pretest 
and posttest population on several instruments, the percentage changes 
were in several Instances minimal. Furthermore, an analysis of the gains 
for several individuals, as Indicated by the individual shifts from the pre- 
test to the posttest, revealed only slight differences. With a small pop- 
ulation, here twenty-one, sizable increases by a few individuals led in 
some instances to statistically significant differences in the pretest and 
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posttest populations when in reality many individuals comprising the 
population changed only slightly. 

The conditions prevailing at the time of the administration of the 
pretests and the posttests must be considered In interpreting the Fellows' 
scores on the various Instruments that were used to measure cognitive 
and attitude changes. Both during the administration of the pretest and 
the posttest, the Fellows were under some strain. For instance, it had 
not been feasible to administer the pretests before classes were under- 
way because of the time that had to be allowed for the Fellows to arrive 
on campus, find and settle in suitable quarters, and begin classes. 

(Through special arrangements, the summer sessions had already been 
reduced from ten to eight weeks in recognition of the fact that several of 
the Fellows could not be released from their schools until late in June.) 
Thus, the conditions existing at the time of the pretest were that classes 
were already underway; furthermore, the pressures of academic pursuits 
coupled with the desires to make good impressions early In the program 
were present. 

Especially during the time that the posttests were administered, condi- 
tions were such that the Fellows could not be expected to perform to their 
maximum capacity. Scheduled sessions had been planned early whereby 
one day every week during the last half of the Spring Quarter would be 
devoted to testing and concluding and summary sessions. The schedule 
was disrupted, however, because the University was forced to close in May, 
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four weeks prior to the scheduled closing time. 

The closing of the University was precipitated by the Kent State 
Incident of 1970 and student, unrest over President Nixon's decision to 
invade Cambodia, ominous events that caused considerable tension in 
the University community. Realizing that the University might close, 
special arrangements were made with the Fellows whereby they agreed to 
take two of the posttests ahead of schedule; one week later the University 
did in fact close. Although all University dormitories were closed at 
that time, families living in University-owned apartments were not forced 
to evacuate. However, students. Including graduate students, were not 
permitted on the campus for two weeks following the University closing. 
Because of this situation, several of the sessions that had been planned 
with the Fellows had to be cancelled. 

Through the generosity of the staff at the B'nai B'rtth, Hlllel Founda- 
tion, facilities were made available to the Fellows following the closing 
of the University. Although several of the Fellows' classes were held in 
these facilities, the Spring Quarter was still brought to an early close. 
During this period, the remaining posttests were administered in the Hillel 
Foundation facilities between regular class sessions. 

There is little question that the Fellows were affected by the disrup- 
tions at the University and that the posttests were taken under adverse con 
ditions . The Fellows were both distracted by the general conditions at the 
University and were also placed in a position where they had to complete 
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work for the various courses in advance of the original schedule. Many 
of the Fellows, meanwhile, made plans to leave for their home towns 
prior to their scheduled departures; the first family to leave made Its 
departure before June 1. 

During the interviews with the Fellows, the external evaluator 
found that "there was unanimous agreement among the fourteen individuals 
r that he interviewed! that they had undergone rewarding learning experi- 
ences. Even those who expressed reservations about instructional pro- 
cedures in the various classes testified to this point. Judging by their 
comments, the Fellows felt they had made the greatest gains in the area 
of knowledge about economics." 

The Fellows confirmed, in part at least, their opinions on this matter 
in their responses to a question on the final questionnaire. Table XXXI 
indicates that all but one Fellow believed they had learned a great deal 
during the year of the ExTFP . 



TABLE XXXI 



THE FELLOWS’ OPINIONS OF THE ExTFP AS A LEARNING EXPERIENCE 



Which of the following alternatives 
best describes your reaction to the 
ExTFP as a learning experience? 


Ph.D. 

Fellows 


M.A. 

Fellows 


Total 


I learned a great deal 


7 


13 


20 


I learned a moderate amount . . . . 


0 


1 


1 


I really didn't learn very much . . . 


0 


0 


0 


I learned virtually nothing at all . . . 


0 


0 


0 



The Tie tubers of the faculty were asked a question on their final 
questionnaire to which a majority responded that the Fellows had become 
better scholars as a result of their participation in the ExTFP. Table 
XXXII indicates their responses to this question. 



TABLE XXXII 

THE FACULTY'S RESPONSES ON THE SCHOLASTIC EFFECTS 
OF THE PROGRAM ON THE FELLOWS 



Did you feel that the Experi- 
enced Teacher Fellowship Education Economics Econ.Educ. Total 



Program resulted in the parti- 
cipants becoming better scholars? 


Faculty 


Faculty 


Faculty 




Yes 


6 


7 


2 


15 


No 


0 


0 


0 


0 


Uncertain 


0 


1 


1 


2 



Reviewed against this background, a number of observations may be 
made. Table XXXIII contains the means and the standard deviations of the 
four tests that constitute the Test of College Economics , each of which 
was used as a pretest and a posttest. Tt may be observed in the table 
that in all instances the mean scores were greater on the posttests than 
they were on the pretests, although by only a slight margin on test Part II, 
Form B. (It should be noted that Part II, Form B was the final test to be 
administered, a circumstance that may have had a particularly adverse 
effect.) Further, the variation among the group decreased in all instances 
as indicated through a comparison of the standard deviations between 
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the pretests and the posttests. The change was only minimal, however, 
on two of the tests, viz. , Part II, Form B and Part II, Form A. 

TABLE XXXIII 

RESULTS FRO ? ‘* THE TEST OF COLLEGE ECONOMICS 



PRETESTS POSTTESTS 



Parti, Form A Parti. Form A 



N 

Mean 

S.D. 

t 


21 
21 .55 
S. 05 
3.39 


N 

Mean 

S.D. 


21 

24.33 

4.44 


Part II 


, Form A 


Part II 


, Form A 


N 


21 


N 


21 


Mean 


19.33 


Mean 


20.95 


S.D. 


5.25 


S.D. 


5.14 


t 


2.33 






p art I , 


For m B 


Part I, 


Form B 


N 


21 


N 


21 


Mean 


21.20 


Mean 


24.66 


S.D. 


7.16 


S.D. 


3.72 


t 


3.43 






Part II , 


Form B 


Part II, 


Form B 


N 


21 


N 


21 


'•'lean 


20.09 


Mean 


21.00 


S.D. 


5.46 


S.D. 


5.94 


t 


.76 







\ It was anticipated that the scores obtained by the Fellows on the 

posttests would show an upward sh' T t, i.e. , that the posttest population 
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would perforn better on the instrument than the pretest population. To 
test the statistical significance of the scores, a_t test was employed; 
since an upward shift was anticipated, a one-tailed test was used with 
N-l degrees of freedom. The critical value ofjt was established at .05, 
thus requiring a calculated t_ value of equal to or greater than 1.725. The 
results from three of the tests, with t_ scores of 3.39, 3.43, and 2.33, 
did show a significance at the .05 level. Two of the tests, Part I, Form 
A and Part T, For m B, in fact Indicated a significant t_ score at the .005 
level . 

Excluding Part II, Form B, the null hypothesis was considered to 
be untenable at the .05 level of significance on the three other forms of 
the Test of College Economics ; the alternate hypothesis was accepted. 
The null hypothesis had been formulated to state that there would be no 
statistical difference between the pretest population and the posttest 
population. This hypothesis was considered to be untenable while the 
alternate hypothesis, that there would be a significant difference between 
the pretest and posttest populations, was accepted. 

The Test of Basic Economics was also administered to the Fellows 
as a pretest and a posttest; the statistical procedures used to analyze 
this test were essentially the same as those used with the Test of Col- 
lege Economics . The test was also analyzed separately; however, for 
the Ph.D. and M.A. Fellows as well as for the total. The results of 



the tests are found in Table XXXIV. 
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TABLE XXXIV 



RESULTS FROM THE TEST OF BASIC ECONOMICS 





PRETEST 




POSTTEST 


Total Population 


Total Population 


N 


21 


N 21 


Mean 


52.71 


Mean 55.85 


t 


3.50 




Ph.D. Fellows 


Ph.D. Fellows 


N 


7 


N 7 


, 'ean 


58.29 


‘•'ean 60.14 


t 


1.31 




M.A. Fellows 


M.A Fellows 


N 


14 


N 14 


Mean 


49.93 


Mean 53.71 


t 


3.39 
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The mean scores on the posttest may be observed to be greater than 
those on the pretest, i.e., the posttest population performed better on the 
test than the pretest population. To test the statistical significance of 
the scores, a t_ test was used with the critical value of _t established at 
.05 on a one-tailed test and N-l degrees of freedom. With a calculated 
t. value of 3.60 the total posttest population indicated a significant differ- 
ence at the .005 level where the critical t is 2.845. Thus, the null hypo- 
thesis, that there would be no significant difference between the posttest 
population and the pretest population, was considered to be untenable at 
the .005 level of significance. The alternate hypothesis was sup- 
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ported, viz . , that there would be a statistically significant difference 
between the posttest population and the pretest population. 

It was thought that perhaps the Ph.D. Fellows would perfor m less 
well on the posttests than on the pretests since many of them had (1) 
concentrated their work during the year in education rather than eco- 
nomics and (2) obtained high scores on the pretest, leaving only a slight 
margin for improvement. Although the posttest scores were not signi- 
ficantly different from the pretest scores, the Ph.D. Fellows did not 
in fact give indication of overall poorer performance. As indicated In 
Table XXXIV, the mean score obtained on the posttest was greater than 
the mean score obtained on the pretest even though there was statistic- 
ally no significant difference between the scores. 

In, analyzing the scores of the M.A. Fellows only, there was evi- 
dent a significant gain in the posttest scores where a calculated t_of 
3.39 was obtained. This score was significant at the .005 level on a 
one-tailed test with the degrees of freedom equal to N-l. 

The critic is well informed that the significant differences on the 
several instruments that were administered to the pretest and posttest 
populations do not in themselves justify a full-year educational endeav- 
or. In fact, an intensified program of, say, two to six weeks may produce 
differences that are as great or greater than the performances of the Fellows 
in the ExTFP. For instance, the Test of College Economics was recently 
administered on a pretest-posttest basis to a group of experienced teachers 
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in a summer economics institute sponsored by the National Science Foun- 
dation and conducted by the staff of the Department of Economic Education. 
After only five weeks, the participants showed a significant difference 
in an upward trend in their scores from the pretest at the .005 level and 
with a greater percentage increase than the Fellows did after a full-year 
of economics instruction. Therefore, even though the scores obtained on 
standardized tests may provide useful information, they should not be 
used to justify a full- year educational program. 

A Survey of Opinions of Economic Issues c onsists of thirty-five 
statements on economic topics to which a respondent may (1) strongly 
agree, (2)- agree, (3) declare indecision, (4) disagree, and (5) strongly 
disagree. The test has not been used extensively or validated; appropriate 
statistical procedures for analyzing the test have not been developed. In 
comparing the responses of the Fellows with the responses made by other 
groups who have been tested, no unusual deviations were observed. The 
responses were then examined to determine if there had been any signifi- 
cant shifts made by the Fellows from the pretest to the posttest. 

The aggregate responses from the pretest and the posttest were 
tabulated and placed into the five categories that the respondents could 
select. Table XXXV Indicates by percentage the combined responses to 
the thirty-five statements. 
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TABLE XXXV 

COMBINED RESPONSES TO A SURVEY OF OPINIONS 
ON ECONOMIC ISSUES BY PERCENTAGE 





SA 


A 


u 


D 


SD 


Total 




PRETEST TOTALS 


CO 

o 

* 


.27 1 


.14 


1 •« | 


.10 


1 

O 

o 


j 

i 


POSTTEST TOTALS 


o 

00 


! .27 , 

1 


.10 


i .43 ; 


.12 


; 1.00 


i i 

i 



As indicated In Table XXXV, there was no aggregate shift in the 
strongly agree and the agree responses between the pretest and the post- 
test. The greatest shift that did occur was a 4 per cent movement from the 
undecided category that was absorbed by the disagree and the strongly 
disagree categories In the posttest This shift from the undecided cate- 
gory may indicate that the Fellows were more confident of their opinions 
on economic issues In the posttest and were therefore, more prepared and 
willing to express an opinion on economic issues upon completion of the 
progra m . 

In examining the responses of the Ph.D. and the M.A. Fellows 
separately, it was found that the greatest shift from the undecided cate- 
gory from the time of the pretest to the posttest was made by the M.A. 
Fellows who shifted from the undecided category by greater than 4 per 
cent whereas the Ph.D. Fellows shifted from the undecided category 
by less than 1 per cent. 

In examining individual items, it was observed that the responses to 
Statement 4 showed the greatest shift for the Ph.D. and the M.A. Fellows 
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combined. Nine Fellows disagreed or strongly disagreed on both the 
pretest and the posttest, therefore showing no change. One Fellow 
changed from the disagree column and moved Into another column. Six 
Fellows shifted from other columns on the pretest into the disagree column 
on the posttest. Five Fellows responded to categories other than the 
disagree or strongly disagree columns on both the pretest and the post- 
test. These data were made dichotomous and recorded in a fourfold 
table as indicated in Table XXXVI. 

TABLE XXXVI 

RESPONSES TO STATEMENT FOUR IN A SURVEY 
/ i OF OPINIONS ON ECONOMIC ISSUES 



POSTTEST 

Disagree Other Total 





Other 


6 


5 


11 


PRETEST 


Disagree 


9 


1 


10 




Total 


15 


6 


21 



To test the significance of the difference between the proportions 
of responses in the disagree category fro n the pretest to the posttest, 
the null hypothesis was formulated that 

Ho: pi= p 2 

where p^ = the proportion of 

responses in the dis- 
agree category In 
the pretest 



O 

ERIC 



202 



p^= the proportion of re- 
sponses in the dis- 
agree category on 
the posttest 

The alternative hypothesis formulated was that 

H l : Pi * P2 

To test the significance of the differences between the proportions 
of responses in the disagree category from the pretest to the posttest, a 
chi square test of Independence for correlated samples was calculated. 

The critical value for chi square was found to be 3.84 at the .05 level; 
the calculated value was found to be 3.57. Since the alternative hypo- 
thesis was not supported in the analysis of responses to Statement 4, which 
had shown the greatest proportional change, the remaining statements 
were not examined. 

The Inventory of Economic Opinions consists of seventeen statements 
to which the respondent may agree or idsagree. The test was administered 
to the Fellows as a pretest and posttest. In analyzing separately each of 
the seventeen Itehs, no statistically significant differences were found, 
l.e., on no one item was there a significant aggregate shift. Using the 
sign test to analyze shifts, it would have been necessary to observe a 
change of four or more responses to a given statement between the pretest 
and the posttest. The greatest shift to occur was three; this degree of 
shift occurred in only two of the seventeen statements . 

Although there were no significant differences observed, it was 
possible to make some tentative Inferences from the test. The statements 
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in this seventeen- 1 Lena test, which was prepared by Roman F. Warlike, 
were drawn fro o Delbert Snider, Economic Myth and Reality (Englewood 
Cliffs, N.J.: Prentice-Hall, Inc., 1965). In this book, Snider treats six- 
teen myths which he uses as chapter titles. He concludes each chapter 
with a statement that represents the economic reality of the topic. 

The Inventory of Economic Opinions represents a whole or partial 
statement of twelve of the chapter-heading myths formulated by Snider; 
four of the state nents represent the whole or partial economic reality. 

For the test, one myth presented by Snider was split into two myths thus 
bringing the total to seventeen statements. Based on the above break- 
down, respondents should disagree with thirteen of the statements since 
they represent myths; they should agree with the remaining four statements 
since these statements represent the economic reality. In analyzing the 
test results , it was observed that several of the Fellows responded in- 
correctly to three of the statements on both the pretest and the posttest. 

The statements and the response totals are indicated in Table XXXVII. 

There was only one known Instance during the year when a reference 
was made to Snider's book. Furthermore, the statements were perhaps not 
clearly stated and therefore subject to misinterpretation. The author of 
the test had, however, informally validated the instrument by administer- 
ing it to a group of professional economists of the University of Minnesota 
faculty some years earlier. Even allowing for some misinterpretation, then. 
It is noteworthy that the Fellows, after a full-year in an economics program. 
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did not show a shift toward a wore correct response. In fact, in response 
to one of the items there was a shift of one toward the Incorrect response 
on the posttest. 



TABLE XXXVII 

THREE STATEMENTS AND RESPONSES FROM THE INVENTORY 

OF ECONOMIC OPINIONS 



AGREE DISAGREE 





Pretest 


Posttest 


Pretest 


Posttest 


Ite m 

3. The primary purpose of 
taxes is to furnish revenue 
to the government. 

^Key: Disagree) 


15 


12 


6 


9 


8. Labor unions are primarily 
responsible for the high 
standard of living of the 
American worker. 

(Key: Disagree) 


7 


7 


14 


14 


10. In the long run, tariffs 
reduce job opportunities 
and lower the standard 
of living. 

(Key: Disagree) 


8 


9 


13 


12 




Although the Fellows were probably not familiar with Snider's book, 
the statements in the test related to topics that the Fellows studied in 
the several courses they had. For Instance, Statement 3, on the topic of 
taxes, was related to government policy, a subject that was studied in 
depth during the year. Similarly, Statement 10, on the topic of tariffs, was 
related to government policy. Statement 8, on the topic of labor, was also 
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a major area that was Included In the course work of the year. 

Perhaps it Is not possible to make conclusive Inferences from these 
responses, L.e., the failure to change Incorrect attitudes toward basic 
economic concepts over the course of a year. It may be, however, that 
It is the nature of many courses and of much of education at all levels 
that teachers and instructors sometimes expect students to grasp funda- 
mental concepts when studying a subject In depth. In reality, educators 
at all levels perhaps do not Identify clearly In their minds or In the minds 
of their students what concepts they are trying to teach. Upon completion 
of a course, a year of study, and even a degree program, students may 
still lack the confidence and the knowledge to speak Intelligibly on funda- 
mental concepts and basic issues in the subject-matter area of their 
studies . 

In conclusion, the Fellows did show statistically significant gains on 
several of the tests that were administered on a pretest-posttest basis. 
These gains were not great, however, and It would be difficult Indeed 
to justify a full-year program on the basis of the results of these tests . 

As suggested by the aggregate responses to three of the statements in the 
Inventory of Economic Opinions, professional educators at all levels must 
give serious attention to basic concepts that should be a part of their 
courses; It may be a false assumption that in-depth analyses of selected 
topics or a superficial survey of many topics provide students with a work- 
ing knowledge of the discipline they have studied. 
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Overall Impressions . The experiences that, occurred during the year 
of the ExTFP left different impressions upon the individuals who were in- 
volved In the program including the participants, the teaching faculty, 
and the directors. There were also several areas of general agreement. 

For Instance, several of the Fellows found that there was little that was 
Innovative about the progra n, an opinion that was shared by several of 
the members of the teaching faculty. Other Fellows and members of the 
teaching staff were of the opinion that the program was Innovative and 
distinctive; the practicum, the group processing sessions and specific 
course projects were singled out as examples. 

Several Individuals commented that the variation among the Fellows 
was greater than may have been anticipated and that as a result the pro- 
gram was less effective than it may have been. One member of the 
teaching faculty thought, for Instance, that the program had been of no 
value for some individuals even though overall it had value. A Fellow 
commented in the final questionnaire that "I think that the wide range of 
abilities and/or backgrounds in Economics was not sufficiently provided 
for in the Program. ... In other words, the group was too heterogeneous 
for 'en bloc' Economics courses." A second member of the teaching faculty, 
however, commented that, although there was variation among the Fellows, 
greater flexibility could mitigate against this variation. Such flexibility, 
he suggested "... is in most cases possible to achieve with no loss 
(and perhaps Involves gain) to other students." 
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It would not be possible to examine all of the opinions that were 
expressed orally and on the written comments that were made In the final 
questionnaires. There are, however, some broad areas that suggest 
overall impressions about the program that are worthy of observation. 

The Fellows were asked in the final questionnaire, for instance, how 
closely the ExTFP met their expectations. Their responses to this question, 
to which a majority said ''very closely," are found in Table XXXVIII. 



TABLE XXXVIII 

THE FELLOWS* OPINIONS OF HOW CLOSELY THE ExTFP VET 
THEIR EXPECTATIONS 



As you think back on this year, 
how closely did the ExTFP meet 
your expectations ? 


Ph.D. 

Fellows 


V.A. 

Fellows 


Total 


Very closely 


6 


6 


12 


Moderately closely 


1 


7 


8 


Only slightly 


0 


1 


1 


Not at all . . 


0 


0 


0 



As suggested by the responses to the question in Table XXXVIII, the 
Fellows were generally of the opinion that the ExTFP had at least to an 
appreciable extent, met their expectations. The teaching faculty and the 
directors were generally of the opinion that the ExTFP had provided a 
valuable experience for the Fellows. Table XXXIX, which Includes the 
collective responses of the teaching faculty and the directors. Indicates 
that the teaching faculty ■-/ id the directors were, with some exception, of 
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TABLE XXXIX 



THE OPINION OF THE FACULTY ON THE OVERALL VALUE 
OF THE ExTFP 



In your opinion, how valu- 
able was the overall program 
fort Participants 


Faculty 


Institution 


Upgrading 
high school 
teaching 


Very valuable 


7 


3 


5 


4 


Valuable 


9 


9 


9 


7 


Undecided 


0 


3 


2 


3 


ifot very valuable .... 


0 


1 


0 


0 


Not valuable at all . . . 


0 


0 


0 


0 



the opinion that the ExTFP was a valuable program for the Fellows, the 
faculty, the Institution, and the upgrading of high school teaching. 

As Indicated In Table XXXIX three members of the teaching faculty 
were undecided over whether or not the program was valuable for upgrading 
high school teaching; one instructor commented that while the program 
was valuable for most in terms of upgrading high school teaching, It was 
“useless for some of them" Although these responses may have been based 
on a lack of knowledge of the total program, there may be some serious 
question raised as to where experienced teachers should turn in their quest 
for information about methods and content that may lead to more effective 
teaching . Although there may be alternate approaches to educating teachers , 
it would seem that the teaching faculty in Institutions of higher education 
would have something to contribute to the total educational process and 
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that a feasible approach would be through a captive audience of experi- 
enced teachers who expect to resu me their profession upon completion 
of a full-year program. 

Similarly, it would seem appropriate that the teaching faculty of 
an institution of higher education would Insist that the educational needs 
of experienced teachers be met over the course of a year and that each 
individual Instructor would make this his responsibility during the time 
that these teachers are under his tutelege. There are a number of Instances 
that may be singled out where instructors provided generously of their time 
during sessions that were held after regular class meetings to provide 
special assistance to the Fellows. Yet, a majority of the teaching faculty 
thought that "probably" the educational needs of the Fellows were met 
during the program. Table XL indicates the opinions of the faculty on 
this natter. 



TABLE XL 

THE FACULTY'S OPINION ON HOW CLOSELY THE PROGRAM MET 
THE EDUCATIONAL NEEDS OF THE FELLOWS 



In your opinion, were the edu- 
cational needs of the partici- 
pants met by the program? 


Education 

Faculty 


Economics 

Faculty 


Econ.Educ. 

Faculty 


Total 


Definitely 


1 


1 


2 


4 


Probably. . 


5 


5 


i 


11 


T doubt it 


0 


1 


0 


1 


Not at all 


0 


0 


c 


0 
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One final overall area of concern Involves the question of content 
versus method, a question that educators have debated for many years. 

Should a course or a program be weighted in favor of subject-matter 
content or methods and materials for communicating effectively? In 
commenting on a question In the final questionnaire, one member of the 
teaching faculty suggested that "the mix of courses should be weighted 
more toward subject-matter areas." Yet, another member of the teaching 
faculty, who taught a course in the same subject-matter area, commented 
by saying " . . .1 cannot appraise which elements of their teaching was im- 
proved. : l! y guess Is they felt somiewhat more confident about content and 
less sure about their previous methods." 

The Fellows were asked two specific questions related to this topic 
to learn their opinions. As was suggested in the report of the external 
evaluator, most of the Fellows agreed that they had "undergone rewarding 
learning experiences." Yet there is some question about the nature of 
the things they learned and whether or not they felt greater confidence In 
content or method upon completion of the program. Table XLI which Indicates 
the responses of the Fellows on this topic, suggests that the Fellows were 
somewhat less confident about the methods they had learned than they were 
about the content . 

Based on the opinions expressed by the Fellows in Table XLI the 
Fellows on the whole believed that they had learned about content and 
methods that they can use In their own work, but their opinions of content 
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TABLE XU 



THE FELLOWS' OPINIONS OF THE USEFULNESS OF SUBJECT-MATTER 
VERSUS METHODS AND MATERIALS FOR THEIR FUTURE WORK 



How about the useful- 
ness of the program for 
your own work concern- 
ing: 


CONTENT 
Ph.D. M.A. 
Fellows Fellows 


Total 


METHODS 
Ph.D. M.A. 
Fellows Fellows 


Total 


Learned a great deal . . 


. 7 


8 


15 


5 


d 


8 


Learned quite a lot . . 


. 0 


5 


5 


2 


7 


9 


Learned little 


. 0 


1 


1 


0 


3 


3 


Learned almost nothing. 


. 0 


0 


0 


0 


0 


0 



indicated that they were more sanguine in that area than In the area of 
method. It. may be difficult to determine which individual or group of 
individuals are the most responsible for teaching communication skills. 
Although there are technical communication skills that can and should 
be learned, it is also true that an individual cannot be said to know or 
understand a topic or subject if he is unable to express his knowledge. 

For the M.A. Fellows, the program was weighted more heavily in 
favor of "content" courses and this may account for their greater con- 
fidence In this area. Yet, the program included a blend of course work in 
economics, education, and economic education that was intended to pro- 
vide the Fellows with a background in both content and method. Addition- 
ally, at least two members of the economics faculty commented speci- 
fically about the considerations they had given to the implications for 
teaching the content that was included as part of the course work. A 
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third economics Instructor, who did not claim to have ^ade specific 
adjustments in his teaching to meet the special needs of the Fellows, 
commented that "T believe changes should be made in the economics 
content and method, especially as it relates to economics and education 
in teacher education. 

The matter perhaps needs a further examination and analysis to 
determine how educators at all levels can most effectively learn content 
as a prerequisite, but then move a step beyond to recognize the subtle 
and complex nature of the learning process that involves the translation 
of content into viable curricula and effective teaching techniques . Although 
a few of the Fellows apparently did not take this extra step, at least 
during the course of the year and as presently perceived, there is evi- 
dence that many of them did; the Fellows who did not were at least made 
more conscious of the fact that this extra step needs to be taken. Per- 
haps even a greater consciousness of the necessary relationship of content 
and method by both the Fellows and the teaching faculty will in time lead 
to more effective teaching and learning at all educational levels . 

Although with exceptions, the program was observed to promote 
the Inter-disciplinary relationship between economics and education. 
Measures that promote this relationship are of particular significance in 
that professional educators have in many instances established domains 
of interest and expertise that separate one discipline from another and 
that further separate all disciplines from teacher education. Meno 
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Lovensteln, Charles G. O’Bleness Professor of Economics, Ohio Uni- 
versity, has suggested that "If economic education is really possible 
it will have to rest upon a thorough analysis of the relations of eco- 
nomics as a discipline to the subtle and complex processes of edu- 
cation." 2 With the help of the ExTFP and other special programs in eco- 
nomic education, the basis for this symbiotic relationship has been 
established at Ohio University along with the potential to develop into 
a more mature and sophisticated relationship. Although it is too early 
to judge, perhaps one of the najor outcomes of the ExTFP will be the 
part it played in promoting the union of content and method, the sine 
gua non of learning and teaching. 

Employment and status changes . It is perhaps Inappropriate to 
examine employment and status changes at this time since there is still 
some uncertainty and indecision among the Fellows regarding the future. 
The period between the conclusion of the program and the beginning of the 
school year in September may be considered a transitional period. During 
this period, several of the Fellows are known to be undecided about their 
futures and are still exploring the opportunities that nay be open to them. 
The lack of information about the changes that may occur after the program 

®Meno Lovensteln. "Economic Education Comes of Age," Selected 
Readings in Economic Education, eds. Roman F. Warmke and Gerald F. 
Draayer. (Athens , Ohio: College of Business Administration, Ohio 
University, 19691, p.55. 
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Is one of the limitations of this study. A survey of the Fellows con- 
ducted a month hence would probably clarify a number of uncertainties 
that now exist; a survey conducted in a year or more would provide 
more valid and pertinent information on the subject. There are, how- 
ever, some data that may be reported at this time that may give some 
indication of the effects that the program had on the Fellows and on 
their professional careers. 

Tn recommending that, each applicant for an Experienced Teacher 
Fellowship Program obralns a leave of absence from the school or school 
system where he is employed, the USOE administration encourages edu- 
cational personnel to return to their former places of employ ment upon 
completion of the program in which the '/participate . This measure also 
reduces the possibility for antagonism that may develop between the 
USOE administration and local school communities. No uncommonly, 
however, there are shifts in employment after a participant completes a 
program. Tn their evaluation of Experienced Teacher Fellowship D rograms, 
Crockett, et.al. reported, for example, that less than 30 per cent of 
the participants in 1967-68 programs had as a first choice the aspiration 
of returning as a "Regular classroom teacher In the present school." 

(Even the use of the word "regular" in the questionnaire may leave a 
malefic connotation.) As with many program participants, several of 
the Fellows showed a desire to change employment, a number of them 



did so. 
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The Ph.D. Fellows, of course, were not expected to return to their 
former positions since It was not expected that they could complete their 
degree programs during the year of the ExTFP and that upon completion of 
their degree programs they might well turn to other educational employment. 
As suggested by one member of the teaching faculty the failure to return 
to classrooms may " . . .for the long run of economic education r be] called 
a good consequence." Six of the seven Ph.D. Fellows do in fact expect 
to continue their degree programs in Secondary Education, two on a part- 
time basis. One of the M.A. Fellows, on the other hand, was awarded 
the M.A. in Economic Education and will continue at the University In 
pursuit of the Ph.D. In Secondary Education with a Concentration in 
Economic Education. Each of the two Ph.D. Fellows who will pursue their 
degrees part-time have taken positions in secondary schools. One has 
taken a position with his former school where he had been employed as a 
classroom teacher; he will return as a curriculum supervisor. The second 
Ph.D. Fellow who will pursue the degree program part-time has taken a 
position with a different school in a different state where he has been 
appointed to the position of social studies department chairman. Tn both 
instances, these Fellows were classroom teachers prior to their participa- 
tion in the ExTFP; both will receive salary increases in their new positions. 

Of the five Fellows who will pursue their degree programs on a full- 
time basis, all have accepted graduate or teaching asslstantships with 
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the University. Three of these are with the Department of Economic Edu- 
cation. One of these three individuals has accepted the appointment of 
graduate assistant to the Kazanjlan Foundation Depository located in 
the Vernon R. Alden Library. The remaining two Fellows in the Depart- 
ment of Economic Education will serve as graduate assistants to an in- 
service institute co-sponsored by the National Science Foundation and 
the Ohio Council on Economic Education. This institute will be admini- 
stered by the Department of Economic Education and conducted for forty 
experienced teachers in the greater University community. The remain- 
ing two Ph.D. Fellows have accepted positions with the Department of 
Secondary Education and will be employed as teaching assistants. 

The remaining Individuals Include thirteen former M.A. Fellows, 
each of whom achieved his degree objective, and one former Ph.D. Fellow. 
Seven of these individuals expect to return to their former schools, or, 
as in two Instances, school systems, where they will continue as class- 
room teachers. Five of these individuals will receive salary increases 
beyond the normal Increment because of their participation in the ExTFP. 

Of the remaining seven individuals, one, a former classroom 
teacher, has signed a contract with another school in another state for 
the position of assistant principal, a change that has also resulted in 
a salary Increase. A second of the remaining group of seven expects to 
attend graduate school and continue studies in the area of economics 
and business. This person has a desire to become a junior college teacher, 
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but may well return to his former school system in January. 

Of the remaining five individuals, two have the option of re- 
turning to their former school systems and probably will; at this time, 
however, they still hope to find different positions . The remaining 
three individuals have forfeited their opportunities to return to their 
former schools or school systems and are presently in search of employ- 
ment. 

The 1970 lob market In education, which afforded nlnlmum op- 
portunities at all levels, may have prevented greater movement of the 
experienced teachers. Prevailing market conditions may also account 
for the several individuals who are at this time uncertain of their employ- 
ment status for next year . 

In responding to a question in the final questionnaire that Inquired 
after iob activities for next year, one of the M.A. Fellows checked the 
category, "Other." In commenting on this response, he suggested that 
"My iob will be the same, but I will be doing better things in the class- 
room." Although there Is some uncertainty over employment and status 
with the Fellows at this time, it is hoped that a later study may reveal 
that the general thrust of the above comment may appropriately describe 
the professional activities of all twenty-one Fellows. 

Institutional effects . Projections of institutional changes that 
may occur in the schools and colleges where the Fellows will be employed 
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in another year would be conjectures that extend beyond the scope of 
this report. As an observation related to this topic, however, the 
external evaluator found that "Virtually all of the M . A . candidates 
held reasonably clear Ideas as to their Intent to attempt changes upon 
their return." In further comment, he noted that " . . .one man, already 
possessing strong Inclinations for Inducing change, said he was even 
more convinced of the need • " 

Evidence of institutional change that will be Implemented during 
the next school year has already been cited, v l , the effects of the 
practlcum that will result in curriculum changes in three of the co- 
operating schools . These schools have Introduced courses in economics 
Into their social science curricula that were a direct consequence of 
the practlcum experience conducted through the ExTFP in cooperation 
with the Ohio Council on Economic Education. A follow-up study of 
institutional changes and the planned curriculum changes In the co- 
operating schools should be appropriate at a later date. 

For the present, some observations relative to the institutional 
changes at the host Institution that were effected by the ExTFP may be 
made. Changes within the host institutions, and the Impetus for further 
change, were identified by Donald Bigelow as a primary objective In 
granting federal support to Institutions of higher education for special pro- 
granns for teachers. 

Institutional changes are perhaps Inevitable# but often show; mean- 
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while the hazards of "grants mansht p" are great. For instance, a pro- 
posal writer must make time in his professional schedule to prepare 
and submit a proposal in request of program support. Because there is 
an opportunity cost Involved, he has less time to conduct research or 
to publish in his area of specialization; in many instances, the failure 
to publish carries penalities. In 1966-67, almost 1,000 proposals were 
received by the IT~OE staff requesting support for Experienced Teacher 
Fellowship Programs. Fifty of these proposals were funded. In 1967-68 
approximately 860 proposals were submitted to the U80E staff In request 
of support for Experienced Teacher Fellowship Programs. Of these, seventy 
' } were approved. One-and two-time losers probably paid dearly for any 

thoughts they nay have entertained for effecting Institutional change. 

Efforts to effect institutional changes are further made difficult 
when It is realized that the "discipline-oriented" educator assumes some 
risk when he demonstrates an interest in teacher education. As colleges 
and universities are presently constituted, there sometimes exists, as 
noted earlier, an artificial dichotomy between non-teacher educators 
and educators who profess to be teacher educators. The professional non- 
teacher educator teaches or conducts research in the "substantive" areas; 
by implication, the teacher educator teaches or conducts "research" in 
areas that lack substance. Not uncommonly, educators in the "sub- 
- - ^ stantive" areas disassociate themselves from educators who are concern- 

ed over the learning process and those things that relate to teacher educa- 
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tion. 

Present arrangements are subject to change The current unrest 
In society at large and the student dissatisfaction with much of edu- 
cation at all levels has already led to Investigations of school policies 
and priorities and a reconsidering of theprocess that Is Involved In 
educating people at all levels . Donald Bigelow has suggested that 

"Indeed, learning about learning currently is the focus of many of our 
7 

best minds." vet, change often comes about slowly, and the wall that 
separates the teacher educator from the non-teacher educator may be 
difficult to destroy despite external pressures and the concern of "our 
( / best minds." 

Since the U30E administration has eliminated support for Experi- 
enced Teacher Fellowship Programs In the subject-matter areas that 
were earlier supported through the Basic Studies Division, many programs 
and program directors may be subject to the criticisms of their colleagues. 
Further, there is some question as to how many of the changes created 
through program support will continue upon withdrawal of funds . On this 
topic, Donald Bigelow suggested when he Introduced the Education Pro- 
fessions Development Act that " . . .directors of programs will be given 

every opportunity to consolidate the gains of the past decade, to exploit 

0 

what has been done, and to explore what might be." Testing for long-run 

/ 'j "7 A Handbook for Directors : Education Professions Development Act, 

^ 1969-70, op.clt. , p. vl. 

®Ibld. p. vlll. 
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institutional effects of the nature discussed by Bigelow may begin now 
that support for the several programs that were funded has been lifted; 
final assessments, conducted some years from now, may reveal that 
these programs had a greater Impact than was Initially realized. 

Tn examining the Institutional effects of the ExTFP on the host 
institution, institutional antecedents must be considered as well as 
the anticipated outcomes. 'Special teacher programs in economic edu- 
cation at. Ohio University antedated NDEA-supported summer Institutes 
by six years and Experienced Teacher Fellowship Programs by some 
fourteen years. The programs at Ohio University, financed through pri- 
vate donations, were administered through the Ohio Council on Economic 
Education. These special programs for teachers conducted by the Coun- 
cil have long enjoyed the support of the central administrative staff of 
the University. For instance, Ohio University's former President, John 
C. Baker was among the group that founded the Council. Former Presi- 
dent Vernon R. Alden served a three-year term as board chairman for the 
Council; President Claude R. Sowle Is also a member of the board. 

The Experienced Teacher Fellowship Progra m in Economic Educa- 
tion that was conducted at Ohio University during the academic year, 
1967-68, gave further impetus to teacher programs In economic education. 
The Experienced Teacher Fellowship Program, 1967-68, In combination with 
the OCEE, generated enthusiasm and support for the inter-disciplinary 
idea of economic education at the University which led to the establishment 
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of the Department of Economic Education and support for the degree pro- 
grams Including the VT.A. in Economic Education and the Ph.D. In 
Secondary Education with a Concentration In Economic Education. Thus, 
the Experienced Teacher Fellowship Program in Economic Education, 1967- 
68, further encouraged the institutionalization of economic education at 
the University that had begun many years earlier. 

When a second program was not supported in 1968-69, the structure 
on which the Department and the degree programs rested was made 
vulnerable and subject to criticism. However, the foundation was firm 
enough and therefore able to withstand this contretemps. Among other 
factors that prevented the dissipation of the Idea as well as the structure 
was the Ohio Council that continued to grow and gain recognition both 
within the Institution and in the larger community outside as a viable 
service component of the University. 

The support gained to conduct the ExTFP again effected Institutional 
changes by focusing attention on special teacher programs In econo mlc 
education. Through this support, the institutionalization of economic 
education was vitalized. 

A multiplier effect may be set Into motion when support Is granted 
in a particular area of education or in any institution or organization. In 
this instance, several special teacher programs In economic education 
were initiated through the efforts of the OCEE, the Experienced Teacher 
Fellowship Program, 1967-68, and the ExTFP. For example, since 1968, 
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the Department of Economic Education has gained program support from 
the National Science Foundation for the academic year, 1970-71, and 
1971-72, to conduct In-service Institutes in economic education for 
experienced teachers within commuting distance of the University. The 
participants in these programs will enroll in courses in economic edu- 
cation that are offered at the University and that were first approved 
for the University curriculum in 1967 to meet the special needs of the 
experienced teachers who participated in the Experienced Teacher Fellow- 
ship Program, 1967-68. 

During the summer, 1863, the staff of the Department of Economic 
Education conducted an N3F-supported cooperative school program for 
social science teachers employed by the Cleveland City School System. 
The Institute was repeated during the summer of 1970 for teachers In the 
school systems of Lancaster and Columbus, Ohio. The Department staff 
has conducted a "Special Clinic" for directors of NDEA and NSF institutes 
In economics and has produced a fifteen-film TV series in economic edu- 
cation for elementary pupils. The Department conducted the National 
Consumer Econo mics Institute for experienced teachers of business edu- 
cation, home economics, and social studies during the summer, 1969, 
an Institute that was supported through the EPDA. Finally, commencing 
in the Fall, 1370, undergraduate courses in economic education for pros- 
pective teachers will be offered at the University for the first time. 

Besides the special programs conducted by the Department of 
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Economic Education, sometimes In conjunction with the OCEE, the ExTFP 
was Instrumental In helping to establish rapport and solidarity between 
two colleges and among several departments. The Ph.D. Fellows, who 
did most of their work In the field of education during the year, helped 
to strengthen the relationship that had been developed with the Depart- 
ment of Secondary Education In the College of Education. Meanwhile, 
the M,A. Fellows, who pursued much of their course work In economics', 
helped to strengthen relations between the Department of Economics and 
the Department of Economic Education. 

While on the one hand the USOE administration has noted on many 
occasions that federal support for special programs would not continue 
Indefinitely, there may be some serious questions raised over USOE 
administrative policies that claim as an objective the wish to induce 
Institutional changes and yet support programs on an erratic and terminal 
basis that discourages long-run effectiveness . In the host Institution, 
despite the evidence of a stable growth pattern, there is presently some 
question over the status of the Department of Economic Education and the 
place of the OCEE in the College structure. Since the Department and the 
Council have a specific interest In teacher education, an Interest and 
area of expertise that distinguishes these unites from other units in the 
College, there exists some uncertainty over the extent of colleague and 
administrative support at the College level now that a major source of 
external funds has been lifted. Thus, although a base has been estab- 
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lished, new perceptions have been gained, and specific programs have 
been established for both graduate and undergraduate students , there 
is still uncertainty over long-run institutional effects. 
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CHAPTER V 




SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS 





I "was shortly after Sputnik that the federal government Initiated 
several major educational programs. These programs were conducted 
under the auspices of the National Science Foundation and the U.S. 
Office of Education and supported through such legislation as the 
Elementary and Secondary Education Act, the National Defense Educa- 
tion Act, the Higher Education Act of 1965, and the Education Profes- 
sions Development Act. These legislative acts were directed toward 
the Improvement of teacher education with the primary purpose of ef- 
fecting positive changes on '1) elementary and secondary teachers, 

(2) elementary and secondary courses and curricula, (3) college and 
university instructors, and (4) the college and university programs in 
which experienced and prospective teachers are educated. 

Although the USOE administration has truncated programs for 
experienced teachers in most of the subject- matter areas formerly sup- 
ported through the Basic Studies Division, there are still demands for 
more and better education In the nation at large and some questions 
over how these demands will be met. Meanwhile , many Americans , 
living in unprecedented affluence since World War II while at the same 
time experiencing acute social unrest and dissatisfaction, have lost 
faith In many of the traditional American Institutions and Ideals . The 
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American system of education, that was thought at one time to hold the 
promise for introducing a new era of equal opportunity and success for 
millions of Americans, has been excoriated for failing to provide di- 
rection, especially to American youth. 

The ExTFP was a part of a major educational experiment sup- 
ported by the federal government, a program that will not be funded 
in another year. The program provided a full-year of academic studies 
for experienced elementary and secondary teachers. It was sponsored 
by the staff of the USOE under the Education Professions Development 
Act and conducted by the Department of Economic Education, College 
of Business Administration, Ohio University. 

I. SUM ''/[ARY OF PROCEDURES 

The procedures used to evaluate the ExTFP were based primarily 
on the rationale and procedures for evaluation developed by the staff 
of the Center for Instructional Research and Curriculum Evaluation 
(CIRCE). Robert E. Stake, associate director of CIRCE and principal 
author of the model, has suggested that the evaluation of educational 
programs and curricula should be based on the full countenance of 
evaluation, l.e. , on a careful description of the program and the judg- 
ments made while the program was in operation. 

After reviewing the rationale for the ExTFP, data that had been 
collected about the program were organized around three major gestalts 
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including Q) antecedents, (2) transactions, and (3) outcomes. Ante- 
cedents Included those data that existed before theprogram began and 
that related to outcomes. Transactions Included those experiences 
that occurred while the program was in operation and that affected out- 
comes . The outcomes were identified as the consequences of the pro- 
gram. To assure a goodness of fit among the three gestalts, the 
organization of the study was patterned after the logical contingency 
between antecedents and transactions , and between transactions and 
outcomes . 

Based on the procedures established in the evaluation model, 
the assessment also included an examination of program Intents and 
a recording of observations . The Intents and observations were juxta- 
posed to determine if there was a logical congruence between them. 

It is sometimes necessary and prudent to make changes in a 
program while It is in operation or in a curriculum during the imple- 
mentation state. Because changes are sometimes made, laboratory 
experimental techniques are often inadequate for program or curriculum 
evaluation. The judgments that resulted In changes while the ExTFP 
was in operation were Included In the program study within each of the 
major gestalts . 

To gather information about the program, the program staff, and 
especially the program's associate director, monitored the program on 
a daily basis . Further information about the program was gathered from 
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the observations made by an external evaluator who Interviewed four- 
teen of the twenty-one Fellows and discussed the program with the 
director, associate director, and several members of the teaching 
faculty early In- May. Additionally, a series of questionnaires was 
completed by the Fellows during the year related to specific aspects 
of the program. A final and comprehensive questionnaire was com- 
pleted by each of the Fellows upon completion of the program. The 
teaching faculty and the program administrative staff completed a final 
questionnaire that was also used In the analysis of the program. 
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XI, S TJM V 'ARY OF FINDINGS 

Members of the Ohio University faculty have over the years con- 
ducted many special programs In teacher education with an emphasis 
in economic education. For Instance, the first summer workship In 
economic education for experienced teachers was conducted at Ohio 
University In 1952; the Ohio Council on Economic Education was 
founded the following year. Since 1952, Ohio University has distin- 
guished itself In economic education by providing educational person- 
nel in elementary and secondary schools with special programs, in- 
service courses, materials, and special services. The Council, which 
derives Its support from business , Industry, labor, and agricultural 
organizations, has greatly expanded Its programs and services in 
recent years . Working in conjunction with other colleges and univer- 
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sities around the State, the Council has provided a systematic and 
inter-disciplinary program of studies to elementary and secondary- 
schools and the teachers within these schools. 

During the academic year, 1967-68, Ohio University was host 
to an Experienced Teacher Fellowship Program in Economic Education. 
Building on the achievements of the Council, this program provided 
an Impetus toward the establishment of the Department of Economic 
Education, a special, academic unit, in the College of Business 
Administration. The establishment of the Department, characterized 
by its inter-collegiate, incer-departmental, and inter-disciplinary 
approach to teacher education, helped to Institutionalize economic 
education at Ohio University. In 1968, Ohio University was granted 
approval by the Ohio Board of Regents to offer an M.A. in Economic 
Education, to be administered through the Department of Economic 
Education. Also In 1968, the University was granted approval by the 
Ohio Board of Regents to offer the Ph.D. in Secondary Education with 
a Concentration in Economic Education to be administered by the De- 
partment of Secondary Education, College of Education. The plan for 
this latter program was formulated by the chairman of the Department 
of Secondary Education In conjunction with the chairman of the De- 
partment of Economic Education. 

Of the twenty-one Fellows selected t.o participate in the ExTFP, 
seven were accepted to pursue the Ph.D. in Secondary Education with 
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a Concentration In Economic Education. Fourteen were accepted to 
pursue the M.A. in Economic Education. The °h.D. Fellows were 
selected on the basis of their potential to become leaders In teacher 
education with primary emphasis in economic education. For the 
M.A. portion of the program, selection preference was given to edu- 
cational personnel employed In poverty areas - rural and urban, and 
to applicants who appeared academically qualified to complete the 
degree program. The fourteen candidates for the M.A. were awarded 
their degrees In June. One Ph.D. candidate discontinued his degree 
program upon completion of the ExTFP; one M.A. Fellow made appli- 
cation to pursue the Ph.D. degree. Of the seven candidates for the 
Ph.D., five accepted assistantshlps and will pursue their degree 
programs while under contract with the University; two accepted 
positions with secondary schools and will pursue their degree programs 
on a part-time basis. Although there was still some Indecision on the 
part of some of the thirteen M.A. Fellows and the one former Ph.D. 
Fellow, seven had plans to return to their former schools or school 
systems as classroom teachers; the remaining seven either accepted 
positions with other schools, plan to pursue graduate studies else- 
where, or were still Investigating other opportunities . 

The candidates for the M.A. degree were scheduled to take the 
major portion of their course work In economics and economic educa- 
tion. Six of the seven candidates for the Ph.D. degree held advanced 
O 
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degrees In economics; the seventh Ph.D. Fellow held an advanced 
degree in education. The course work in education for the Ph.D. 
degree centered around (1) statistics, ( 2 ) research and design, and 
(3) curriculum theory. In the economics component of the program, 
candidates for the degree were expected to demonstrate proficiency 
in the broad field of the discipline rather than in a content special- 
isation. 

Of particular significance to the degree programs and the ExTFP 
were the mandatory courses in economic education. In these classes, 
the Fellows studied the structure of the discipline of economics as a 
means for facilitating communication and translating the discipline 
into viable curricula and effective teaching units. These courses 
were team taught by the director and associate director of the ExTFP 
and had as a culminating experience the writing of colloquium papers 
that could be used as programs of study in economics in the school or 
school system and grade level where each Fellow expected to teach 
' 'upon cornpletldn'of the progfa The intent of the paper was~to~pro- - 
vide a means for each Fellow to synthesize a number of experiences 
and knowledge including (1) previous professional experiences, (2) 
practlcum experiences, (3) economic theory, and (4) curriculum ap- 
plication. 

Besides the regular courses in economics, education, and eco- 
nomic education, most of which were offered en bloc, the ExTFP 
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included a practlcum and a group process experience. The practlcum, 
that was mandatory to all Fellows and offered for course credit during 
the Fall and Winter Quarters, was directed toward providing a means 
for combining theory and praxis and for effecting change in the coop- 
erating schools. The group process experiences were mandatory but 
offered non-credit and scheduled during the interim between the 
Summer and Fall Quarters, and periodically throughout the year. 
Although the formal sessions were curtailed early in the. year, the 
co-directors of the group process sessions continued to work with 
the Fellows on an individual and informal basis . 

III. SUMMARY OF CONCLUSIONS 

The stated rationale of the ExTFP reflected the priority of edu- 
cational needs identified by the USOE. Specifically, the priorities 
identified in the program proposal submitted to the USOE adminis- 
tration in request of support for the ExTFP included the participation 
of educational personnel who could Q) fulfill leadership roles in teach- 
er education generally and economic education specifically and (2) 
effect positive changes In elementary and secondary schools and 
local school systems and communities. Additional priorities identi- 
fied in the program proposal included the opportunity Q) to expand the 
liaison between the University and elementary and secondary schools 
and (2) to establish an image of University-school cooperation for 
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emulation by other departments and divisions within the University. 

These priorities were met through the program which was struc- 
tured to provide the participants (1) a rigorous and systematic program 
of study, ( 2 ) a substantive background in economics, (3) assistance 
in translating economics and scientific methods of inquiry into viable 
curricula for elementary and secondary schools, and (4) knowledge 
of the new and challenging materials in economic education for class- 
room use . 

The effectiveness and efficiency with which the goals for the 
ExTFP were met was suggested via an analysis of the program's ante- 
cedents, transactions, and outcomes. In the analysis of the ante- 
cedents, for instance, it was observed that the context in which the 
ExTF p was conducted was especially well suited to conduct the pro- 
gram and to derive benefit from conducting Lt. A Department of Eco- 
nomic Education working vls-a-vls the Ohio Council on Economic 
Education gave evidence of many years of involvement and commit- 
ment to teacher education with an emphasis in economic education. 

It was observed, however, that the commitment was not as readily 
- evident at the college level as it was at the University level. 

The curriculum content was especially well-suited for elemen- 
tary and secondary teachers and especially those individuals who 
could be expected to provide leadership in teacher education upon 
completion of the program. The existing masters and doctoral pro- 
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grams offered by the host institution had been designed especially 
to meet the special needs of educational personnel and included 
preparation in economics, education, and economic education. 

Special features that had been Included in the ExTFP were 
based in large part on previous experiences with similar programs 
and on the fact that a proposal for an Experienced Teacher Fellow- 
ship submitted to the USOE administration the year before had not 
been approved. Among other features, the ExTFP included a series 
of courses in economic education, a practlcum experience, and group 
process experiences . A request for support to conduct a special 
pre-program project to disseminate information about the program in 
the Appalachian regions in the tri-states of West Virginia, Kentucky, 
and Ohio was not supported. 

The selection process was carefully considered and executed, 
"tated selection preferences Included the potential for leadership in 
teacher education for the Ph.D. applicants; for the M.A. applicants, 
selection preference was granted to educational personnel employed 
in economically depressed areas and to applicants who appeared qual- 
ified to complete the program. These stated preferences were carefully 
observed in the selection process . 

To account for the effectiveness and efficiency with which the 
program was conducted, an analysis of the program's transactions was 
made. It was observed, for Instance, that the summer introductory 
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courses Ln economics, although carefully planned, were not altogether 
effective in meeting the special needs of social science teachers who 
did not have an adequate background in economics or mathematics 
prior to participation in the program. It was observed further that 
many of the course instructors did not make adjustments in their 
methods of instruction or in course content to meet the special needs 
of theparticipating Fellows. It was found, however, that there were 
exceptions, that some instructors in fact made a specific effort to 
meet the needs of the Fellows. The courses in economic education, 
that were directed toward the translation of the discipline of economics 
into viable curricula were generally well received but were not judged 
to be particularly effective by a minority of the Fellows as they per- 
ceived these courses near the conclusion of the program. 

Conflicting evidence about the effectiveness of the practicum 
made it difficult to arrive at conclusions . The external evaluator con- 
cluded that the practicum was basically an ineffective enterprise. The 
Fellows generally substantiated this position, buFsuggested that even 
when the practicum was not effective, "negative" learning often took 
place. To the extent that the practicum did not succeed, much of the 
problem seemed to rest with the lack of cooperation by the personnel 
in the cooperating schools. It was learned, however, that even those 
practicum experiences that were judged to be unsuccessful, may 
have resulted in curricular changes in several of the cooperating schools. 
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The non-credit group process sessions were allowed to "fade 
out" early in the year. The Fellows were apprehensive of these ses- 
sions before they began. A review of the Fellows' responses to a 
questionnaire that was completed shortly after the first week, how- 
ever, revealed that many of the Fellows had found these sessions 
to be helpful. Although the sessions that had been planned for later 
in the year were discontinued, the co-directors provided counseling 
services to several of the Fellows on an Individual basis. 

The morale and esprit de corps of the Fellows was maintained 
at a generally high level throughout the year. The Fellows tended to 
study together In small groups but there was little antagonism among 
groups or between individuals. 

The administration of the program was well coordinated; the 
division of labor between the director and associate director was 
effective. The relationships that existed between the Fellows and 
the associate director and between the associate director and the 
director were especially effective and probably helped to prevent any 
major problems throughout the year. One area of weakness in the 
communication flows and relationships was, however, identified to 
exist among the teaching faculty and between the teaching faculty 
and the director of the practicum. Additionally, none of these indi- 
viduals maintained effective relationships with the co-directors of the 
group process sessions. 
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The outcomes of the program could only be estimated because 
the program was only recently concluded. Although the Fellows 
showed significant differences in their understanding of economic 
terms, concepts, and generalizations as measured on several testing 
instruments, the percentage gains were not great. It. was suggested 
that adverse conditions, such as the early closing of the University 
in the Spring Quarter, contributed to their failure to perform better 
on the posttests . 

The Fellows were of the opinion that they had learned more con- 
tent than effective means for communicating content during the year . 
Tt was concluded that teachers and instructors need to become more 
conscious of the subtle and complex learning process that may re- 
quire as a requisite a clear identification and statement of concepts 
that are to be taught and learned. 

Although an account was made of employment and status changes 
among the Fellows since the termination of the program tt was con- 
cluded™^^ follow-up study should be conducted to determine the 
effectiveness of the program with the participating Fellows. 

Similarly, although some projections were made, the institu- 
tional effects that may result from the program — in the host institu- 
tion, the schools that cooperated in the practlcum, and the schools 
where the Fellows will be employed — were recommended for a later, 
follow-up study. 
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IV. recommendations for future teacher programs 

Program accountability, as represented in this study, has given 
the author of the study insights that may be helpful to structuring 
long-term programs for experienced teachers . A number of recom- 
mendations may therefore be made that are based upon the experi- 
ences of the program and the assessment of its effectiveness . 

The dissemination of information about a program should be care- 
fully planned. Preferably, a pre-program project should be Included 
in order to solicit applications from educational personnel for whom 
the program is intended. Where such a pre-program project is not 
feasible, other efforts should be made to disseminate Information 
about the program to the types of individuals toward whom the program 
is directed. A mass mailing of program brochures is perhaps the most 
efficient means for wide-spread distribution, but such mailings cannot 
be relied upon too heavily for the dissemination of information. Alter- 
native approaches should also be considered. 

Similarly, the selection process should be carefully treated. 

Every effort should be made to select individuals who appear acade- 
mically qualified to complete the program and able to adjust to gradu- 

ate studies on a full-time basis. 

The orientation of the teaching faculty and other Individuals in- 
volved with the program should be given careful consideration in 
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planning a program. Preferably, the teaching faculty and others in- 
volved in the program should be brought together for a discussion of 
the nature of the program, its maior objectives, and some of the major 
characteristics of the participants prior to the arrival of the partici- 
pants on campus. -'-Special efforts should be made to introduce every- 
one present to the major thrust of the program and to the responsi- 
bilities of each of the several individuals contributing to the total 
program. 

Special efforts should be made also to select instructors for the 
program who are willing to make a commitment to the program and who 
are willing to experiment with new teaching techniques that may be 
useful to the participants at a later date. The course instructors 
should therefore be prepared to deviate from usual course content and 
methods in order to meet the special needs of professional teachers. 

To coordinate the program effectively, thought should be given 
to the possibility of scheduling additional sessions for the teaching 
faculty- and- ■"■the r? involved program, perhaps near t he end of 

each quarter. The need to maintain effective communication flows and 
relationships among the teaching faculty and other individuals ir olved 
in the program should be considered a vital need. 

Although time constraints may prevent a lengthy orientation 
period for the participants, at least the first two days of the program 
should be scheduled for both formal and Informal sessions. During 
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these two days, the participants should have the opportunity to discuss 
the program informally with the administrative staff of the program, 
the teaching faculty, and with the other individuals involved In the 
execution of the program. It would also be appropriate at this time 
to learn more about the participants via the administration and scoring 
of standardized tests and an analysis of the responses to a general 
questionnaire that inquires after personal objectives, expectations, 
and preparation in the subject-matter area of the program. 

Introductory su mmer courses in the subject-matter area should be 
planned if possible. Preferably, however, the program director or an- 
other member of the program’s administrative staff should teach one 
or more of these courses for the purpose of giving the participants help- 
ful direction and to learn more about them at the outset of the program. 

If it is not feasible for a member of the administrative staff to teach 
these courses. Instructors appointed to teach any of the Introductory 
courses should demonstrate an interest In the program, a commitment 
to -the idea that it represents , and. a -Willingness to grapple with the 
special needs of the group. 

The ExTFP provided course work In economic education each 
quarter. These courses gave assistance to the participants for making 
transfer of content into teaching units and curricula. All course in- 
structors should, of course, be conscious of the need to provide the 
opportunity for the participants to make this transfer. Transfer is a 
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difficult process, however, and specLal courses directed to this end 
should preferably be Included in any program in order to emphasize 
the need and to identify clearly and specifically ideas that may be 
helpful in making this transfer possible. 

Care should be taken to avoid clashes between groups and among 
individuals. The combination of Ph.D. and M.A. candidates in the 
ExTFP was a potential source of irritation. However, through careful 
planning and the excellent cooperation of the participants, serious 
conflicts were avoided; in fact, this combination of individuals pro- 
duced favorable results in many Instances. However, when different 
combinations of individuals are Invited to participate in a program, as 
for example, the combination of Ph.D. and M.A. candidates, activities 
should be arranged that militate against conflict. 

Of particular Importance to successful programming is the need 
to assign an individual to the task of monitoring all phases of the pro- 
gram. Accountability is enhanced through such a measure. Further, 
an Individual in this role should be readily accessible to the program 
participants and to the other individuals involved in the program for the 
purpose of easing potential problems and conflicts. This role may be 
filled by the program director himself. With the ExTFP however, it was 
found that there was a distinct advantage in having an associate di- 
rector for the program. The associate director in this instance had been 
Involved in all phases of the program and shared the responsibility 
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with the program director for maintaining the successful operation of 
the program. The advantage of having an associate director for the 
program was that the program participants were readily at ease with 
hi m and readily discussed conflicts, problems, and potential sources 
of irritation. These discussions and the action that sometimes follow- 
ed were probably helpful In minimizing Irritations. 

Practlcum experiences are difficult to organize and Implement 
effectively. Any planned practlcum experience should therefore be 
organized with great care. It is of primary Importance to orient the 
program participants to the planned practlcum and Its rationale. Tt Is 
especially important that educational personnel In the cooperating 
schools are committed to the Idea of the practlcum and they have 
adequate time to perform appropriate services and the necessary 
cooperation . 

Group process sessions may have merit, but they must be care- 
fully planned and Implemented to be successful. The report of the co- 
directors of the group process sessions that were part of the ExTFP in- 
cluded several specific recommendations relative to group process. 

The report of the co-directors may be found in Appendix G . 

It Is recommended that adequate facilities be provided for the pro- 
gram participants. Preferably the participants should have access to a 
special library or resource center such as the Curriculum Materials 
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Laboratory provided to the Fellows in the ExTFP. This study area 
should be sufficiently large to accommodate all of the program parti- 
cipants at one time and should be adequately furnished so as to con- 
tribute to morale and encourage positive interaction among the 
participants . 

Finally, it is recommended that particular efforts be made to 
orient and gain the support of the administrative officers in the 
several units of the host institution. In the case of the ExTFP, this 
was a sometimes difficult assignment at the college level. Rap- 
prochement with the administrative staff at most institutions and at 
most levels may perhaps be achieved with less difficulty; it is recom- 
mended that every effort be made to do so. 

V. RECOMMENDATIONS FOR FUTURE RESEARCH 

Since this report was prepared less than two months after the 
conclusion of the ExTFP, there were several subjects for investigation 
that could not be studied. Three major categories of interest for 
subsequent study may be recommended as appropriate for investiga- 
tion at a later time. 

The first of these categories relates to the Fellows who parti- 
cipated in the program. A study should be made to determine the 
employment and status of the Fellows with special regards to the 
influences they may have in their respective institutions of employment. 
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With the Ph.D. Fellows, for Instance, some estimate maybe made of 
the extent to which they were able to Influence teacher education 
programs as well as the direction of this Influence. With the M.A. 
Fellows, some estimate may be made of the extent to which their 
own classroom teaching was changed as well as the influences they 
may have on other educational personnel within their schools, school 
systems, and larger communities. 

A second and closely allied subject for future research should 
center upon an analysis of the extent to which the Fellows were able 
to cause changes in curricula at whatever level they may be. Special 
attention should be given to the development of teaching techniques 
and approaches to restructuring content so that it can be more readily 
mastered by the learner for whom it is Intended. 

The third and final major category recommended for future re- 
search should be directed toward an analysis of institutional effects. 
Within the host Institution, for Instance, a study should be made of 
the status of the Department of Economic Education, especially within 
the College, to determine the success of the Inter-collegiate, inter- 
departmental, and inter-disciplinary approach to teacher education. 
The study should also include an analysis of the extent to which other 
departments and divisions within the University may have patterned 
■> programs and courses after the design established In economic edu- 

cation . 
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As a corollary to the third recommendation, future research 
should be directed toward an investigation of the effects of the ExTFP 
that may be found in the schools that cooperated with the practicum. 
Additionally, the study should include an investigation of the extent 
to which cooperative efforts between the host institution and 
elementary and secondary schools generally were strengthened as a 
result of the ExTFP. 
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APPENDIX A 



THE ORIGINAL PLANS FOR AN 
EXTERNAL EVALUATION 
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Prepared by 
J. Thomas Hastings; 

Center for Instructional Research and Curriculum Evaluation 
University of Illinois 
270 Education Building 
Urbane, Illinois 61S01 



External evaluation may have at least three meanings operationally: 

1 . A group v/ith no known connection with the development 
agency (D.A. )--except ad hoc contract--is employee to 
evaluate the program being developed* The "external" 
group (E.G.) may be employed by the D.A. or by some third 
agency which has funding or use relations with the D.A* 
or its products. 

The E.G. must know the general purpose of the programs, 
the general type of student to be served, and general 
capabilities of instuctional personnel and characteristics 
of facilities. From there on the E.G, develops the more 
detailed specifications of objectives (perhaps using 
statements from general guidelines of professional groups, 
from studies of needs, et cetera),* descriptions of instruc- 
tional strategies; measures of outcomes (student, institu- 
tion, social); and prepares a report--unila£erally--of 
description and judgment. The communication contact with 
the project is minimal although the observation contact is 
large. 

The "ownership syndrome" of judgment is minimized, but it 
may be that the selection of observations is less than 
maximally appropriate to decisions to be made by the develop- 
ment group. This is obviously so for decisions on revision 
during development. However, such observations may be 
highly appropriate to decision outside the developer. 




2* The E.G. is employed--in this case by the D.A. --to execute 
independently certain specified observational, descriptive, 
and judgmental tasks. The selection, of tasks is made by 
the D.A., on criteria having to do with capabilities 
(personnel, equipment, relations with subjects in the 
program) or v. 7 ith an intent to multiply the ‘-locally available 
staff by subcontracting for certain opera tions--e . g. , test 
building, scoring, and interpretation. 

In this operational mode the E.G.* is external mostly in 
the geographic sense. The D.A*. may delegate more or less 
independence to the E.G. for quality and for interpretation 
of communications about purpose, style, or background. 
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1 (. 

: . The "ov.T.ership syndrome* 1 is not minimised although the D.A. 

| may ask for suggestions or criticisms which could correct 

; Lho bias seme. The* selection of observations is completely 

i \ in Che hands of the D.A,, within Che limits of validity. 

I * Judgmental aspects used in re porting are ur.de r Lho control 

! of the D.A. although they, like ins tremens cons true ticn, 

| could be delegatee to the Z . G. 

| 

! 3. The Z.G. has no developmental connection. *;;■ i ch the D.A. hot 

I lv.ay have 1 a s ti tutic a a 1 re la cions h ins. Th o r e s ponsib i li zy 

| for cocisi o ns on a tr a to gi c s a nd cc tic as bol o ngs tc the 7; . A . 

■■ However, she main reasons for using the u,G, in this mode 

\ are to broaden the perspective of evaluation, to check 

I strategies against non-B.A. thinking, to provide observers 

I in those situations in which local -staff observations would 

I be more reactive, and to provide a source of non -D.A. 

■ judgments about observations. The E.G. in this situation 

I is part consultant and part operator-, bn general, the Z. G. 

; is involved from near the beginning until the final reports 

! are completed. 

| For examples; The E.G. may criticise or help develop tests, 

questionnaires, or interview schedules* but for such work 
great care is given to comr.iur.ica ticn of intent, of expected 
V decisions, and of standards. They will interview students, 

teachers , and users especially in those cases in which 
. staff members of the D.A. might have difficulty in obtaining 
I open responses, because of experience they may be able to 

suggest sources of standards and judgments of which the 
D.A. is unaware. 



In this mode, the "ownership syndrome 11 is corrected though 
certainly not minimal; the selection of observations is 
jointly developed; the D.A. has full responsibility for 
the use of the evaluation results. 



CXRCS's staffing and manner of operation are more congenial to the third opera- 
tional mode than to the others. The operation described in the first setting is 
not at all appropriate co CIRCE * s current image of its own operations. 
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Below are two budgets with indications of tasks which might be attempted in each. 
In each case the activities of the E.G. (’whether CIRCE or some other group) arc 
meant to represent the third mode of external-evaluation operations. The first 
budget is intended to represent c rather minimal effort worth doing. The second 
should add value to the first more than equal to the added dollars. 

Each plan assumes that appropriate personnel are available ar.d that administra- 
tive arrangements of a satisfactory sort can be made. 
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(£:: ternal Evaluation Kodc 3) 

September 1, 1969 - August 31, 1970 

Budget Estimates 



Coordinator--25 cays £ 5100 $ 2,305 

Specialist Consultant (Economics) 5 Gays (g $100 ) 

) 

Specialist Consul caivc (School E>: nor i o nc s ) - - 5 days £ 5100 ) 1,500 

) 

Specialist Consultant (Social Psychology ana Learning) --5 days G 5100) 

Research Assistant--!; time, 12 months 1,505 

Clerk-Typist— ?$ ??2, 12 months 1, 205- 

Travel 

Consultants --or.e 3 -day each 

(3 x 150 + 3 x 3 x 20) 635 

Coordinator-- five 2-clay 

(5 :: 150 r 5 x 2 x 20) 950 

Research Assis tants -- three 2-day 

(3 x 150 + 3 x 2 x 20) 575 



Data Handling 



5 M50 



107* of salaries overhead 



$10,320 



The Coordinator would spend about two days per month over the year, but two -fifths 
to one-half of that time' would be at the development location working with the. 

D. A. in a consulting capacity or helping the Research Assistant and Consultants 
with interviews and questionnaire administration. The tnree Consultants probable 
would make one trip together for observation and interviews. This trip would rn.es c 
probably take place about two -thirds to three- fourths of the way through the 
academic-year program. Their other two days would be taken in briefing before 

the visit and debriefing on return. The Research Assistant might spend most of 
his time helping with preparation of observation and interview schedules during 
the first fourth or third of the period and curing the last two or three months 
in data handling. 

Although the E.G. would’ write a report on specific parts of the total evaluation 
and would help the D.A. relate its parts to theirs, the reporting done by the 

E. G. would be largely in the form of drafting material --and giving suggestions-- 
which would be incorporated by the D.A. into the final report. 

n • 

It -would be expected that the D.A. would conduct the appropriate test development , 
observations, and antecedent data collection necessary to formative evaluation 
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curing the course. Tsc quantity end type of data collected by the J.O. vreu 
of vary little value unless they could ho related to the mere continuous da 
student change end course transactions obtained by the D.A . ‘dot only would 
from these moves be available to the K.G., but the Coordinator and the has... 
As s I s ten c would spend a small part or their time making suyoes tiers .'or 
criticising evaluation materials developed by the D.A, end helping to rein t 
both sets of findings. 

Obviously, adjustments would have to be made only in the* amounts for the Co 
dire tor and .he has ear eh Assistant if it seamed desirable for their cvrlur.t 
work to bu^in earlier then September 196r--urieas additional travel were co 
plated. 
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i'l.iri II 

( i !*;•: t a r r. a 1 d v; : 1 u :: Lion in » o o 3 } 

September 1, 1969 - Augus t 31, 1970 

PI ca II, as stated before, is ms roly an extension oi: p i an 1; bur because of oboe r 
vetiona spread from early to late in. the program^ there would be a possibility of 
improving the inferences one their certainty by several fold. Also, the earlier 
da U\ -col lection periods could serve in part for trial revisions of' instruments. 

T : e m n i n c h a n g e s v; o u 1 d be t i ; o s e of a a a dded . ob s e r v a t ion period b y L h e C o n suit a n t s 
:: a o b s or va c i o n a p p i* o:-: i ma t e 1 y e a c h by th e Coord i : \o t o r a nd he c ar eh A a . . t :: n t , a r. d 
more help by the Coordinator and Research Assistant in the dove lopreent- and inter- 
pret a u i o n o f t V: a ins t r u;r.e n t s used b y t h e 3 , A . 

All conditio ns o f i nvc Ivor, an t - - indue i ng nvs i 1 nb i 1 i ty of staff and a p pro or in t e 
administrative approve l--v:ould maintain as in Plan I. 



Budget Estimates 



Coordinator --3 5 days (3 $100 $ 3,500 

Specialist Consultant (Economics )--S days (?. $100 ) 

) 

Specialist Consultant (School Experience)- -S days (ft £100 ) 2,400 

) 

Specialist Consultant (Social Psychology and Learning) --S days @ $100) 

Research Assistant -- h time, 12 mouths 3,000 

Clerk-Typist--!* PTE, 12 months • 1,200 

Travel 

Consultants --tv?o 3 -day each 

(2 x 3 x 150 * 6 x 3 x 120) 1,260 

Coordinator- -nine 2 -day 

(9 x 150 9 x 2 x 2G ) 1,710 

Research Assistants --six 2 -day 

(6 :c 150 9-6x2 x 20) 1,140 

Data Handling 1 > QQQ 



10% of salaries overhead 





Prepared by 




$15,210 
1 .010 
$16,220 
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J. Thomas Hastings 
CIRCE 

University of Illinois 
270 Education Bui lei ny 
Urbane, Illinois 61001 
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Report by Gordon Hoke, Program Developer, Center for 
Instructional Research and Curriculum Evaluation, 
College of Education, University of Illinois, Urbana- 
Cha mpalgn. 






The following material represents information obtained from 
interviews with fourteen (14) Individuals involved ir the Experienced 
Teacher Fellowship Program in Economic Education and Related Social 
Sciences, Department of Economic Education, Ohio University, Athens, 
Ohio. Interviews took place on May 6-7, 1970. (See page 8 for 
copy of interview protocol . ) 

Antecedents 

1) Program Context — There were indications that participants 
saw a lack of integration among the various components — l.e., 
courses in economics, in economic education, and in secondary 
education. Part of this feeling, particularly in the case of 
candidates for the M.A. degree, apparently stemmed from a lack 
of in-depth knowledge concerning economics. Several were 
especially sensitive to the math requirements for which they saw 
themselves as ill-prepared. All students, however, saw the courses 
in economics as a rich source of input, even when allegedly weak 
instruction was present. Also, M.A. personnel thought they were 
rushed through the summer Introductory course. Their reactions were 
supported by observations made by Ph.D. candidates who were not 
enrolled in the same class but did mix Informally with their colleagues. 
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2) Program Administration — Interviewees were consistent in their 
praise of work done by the director and the associate director. 
However, some questions were raised about the efforts of public 
school personnel involved In administration of the practlcum segment 
of the training enterprise. 

3) Curriculum Content — There were few negative comments 
directed at the curriculum per se. "Unrealistic" demands posed 
by certain courses in economics were cited above. Three of the 
fourteen Indicated their history of public school teaching should 
have excused them from classes in education with more choices 
offered in the social sciences. Severe criticism of the practlcum 

* -v 

was expressed; on the other hand, a somewhat unusual practlcum 
received generous praise . 

4) Student Characteristics — Interviews revealed — judging 
by both verbal and non-verbal cues — a greater- variance among 
participants than may have been anticipated by those In charge 
of the program. Outside of the three Ph.D. candidates, only one 
person recounted any extensive study in economics. Few have had 
work in sociology and anthropology, thus reflecting the long-standing 
emphasis on history in the preparation of public-school social 
studies teachers. Since these people are thirty and above, their 
backgrounds logically fit into the pattern. 
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Transactions 



1) En Bloc Programming — Comments during the interviews 
Indicated that the Fellows were not reacting t.o the course 
sequence as true bloc programming. They perceived the Institute 
as having four distinct elements, each having a definite role, but 
little integration of the quartet. Tt Is interesting to note that 
students apparently saw little rigidity in the bloc scheduling; In 
fact, there were several comments praising its flexibility. 

2 ) Practlcum Experiences — If the intent of the practicum was 
to provide a link between theory and practice, it experienced 
little success. Perhaps this result was to be expected, since 
remarks concerning the practicum varied widely, ranging from 
"excellent" to "a wasted period of time." it seems fair to state, 
on the basis of these interviews, that personnel operating at the 
site of the practicum have considerable Influence on the quality 
of Its learning potential. 

3) Group Processing — There was much uncertainty displayed 
about this part of the Institute. Participants admitted there was 
considerable resistance to It from the beginning. Most felt 

it. had simply been allowed to fade out. One or two stated that no 
one in the total program — l.e. , participant or instructor or 
administrator — seemed vitally interested In continuance of these 
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sessions, and this perception was confirmed by the director. But 
the protocol question focused on "group" processing. It was later 
discovered that the Trainers were spending some time with participants 
on an individual basis. 

4) Courses in Economic Education — There was little specific 
mention of courses taken In this field. As noted previously, the 
bulk of M.A. candidates displayed varying degrees of anxiety 
relative to the requirements in economics. Doctoral students did 
not single out economic education for remarks . 

5) Communication Flows — Within the group of participants 
it was apparent that the Ph.D. candidates had provided strong 
leadership along with both intellectual and psychic support. There 
were evidently numerous opportunities for Informal exchanges, 
although a small minority may have had a disadvantage here. 

Participants were appreciative of the availability of the 
associate director's time and attention. "Very accessible," was 
a common response. 

Perhaps the major problem in this area stemmed from the practicum. 
Communication between the campus and the school, between Fellows 
and personnel active in the public schools, and among the Fellows 
working In a particular locale combine to place great demands for 
effective communication on all concerned. 
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Outcomes 

1) Cognitive Changes — There was unanimous agreement among the 
14 individuals that they had undergone rewarding learning experiences. 
Even those who expressed reservations about Instructional 
procedures in various classes testified to this point. Judging by 
their comments, the Fellows felt they had made the greatest gains 
in the area of knowledge about economics. 

Mot one, though, referred to work In the field of "Related Social 
Sciences." Given the traditional classroom approach to the teaching 
of economics: "Economics is taught as if they're training economists," 

( stated one of the Ph.D. candidates — and the absence of studies in 

other social sciences , it may be wise to analyze carefully the means 
used to achieve certain goals . I am referring specifically to point number 
2 in the instructional program as cited in the brochure. 

2^ Attitude Changes — All interviewees made certain statements 
concerning the positive effects emanating from Involvement in the 
program. Several of the older men said it has given them a second 
chance. "It was a big psychological boost. I needed that (M . A . ) 
degree . Had not foreseen how I could ever get it . " Most indicated 
that participation in the program gave them a new lift, a different 
perspective concerning their teaching. Some of the younger men 
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obviously intended to use the year as a base for completing doctoral 
study. 

The two women seemed rather vague about attitude changes . 

And there may be one type of transaction affecting the Tien which is 
less meaningful or open to women. Namely, the casual, informal 
interaction occurring between men who are freed from normal duties 
and lob responsibilities. 

At least two individuals were singled out as Influencing 
attltudinal changes. Did the women have less contact with them? 

I suspect so, even though one of the former lavishly praised efforts 
made by male Ph.O- Fellows. In addition, two men, who were 
commuting, apparently had less contact with their colleagues . 

The Group Process approach, which evidently lost its "Group" 
focus in the fall, probably would have Induced other changes. Also, 
it was letter revealed in conversations with the Trainers from 
counseling and guidance that Individual consultations were being 
held throughout the year. If attitude changes are to be measured in 
a fairly precise manner, the avenues for effecting them need careful 
monitoring . 

Both of the Fellows who praised their practicum so highly 
noted how much it had "changed" them. Pointing out that his year 
at Ohio University had "Increased his respect for the economic 
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system under which we live," a member of this team noted that 
"it was a great experience." Future efforts at evaluating practlcums 
should be encouraged to clearly distinguish between the dynamics of 
the teaming arrangement and the practlcum Itself. 

31 Institutional Effect— Virtually all of the M.A. candidates 
held reasonably clear Ideas as to their Intent to attempt changes 
upon their return. The two women seemed less certain; one man, 
alreadypossesslng strong inclinations for inducing change, said 
he was even more convinced of the need . 

Not all Fellows are returning to their home base. Ph.D. 

( candidates appeared to be less-change oriented than other males. 

It was difficult to distinguish between changing personal goals of 
* doctoral students , which might or might not relate directly to 
institutional vhange, and the broader focus of institutional 
revision. Does the pursuit of an advanced degree, particularly 
among older men with experience, reduce significantly personal 
willingness to engage in risk-taking endeavors? 
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Interview Protocol 



1. y/hat. did you see as the major purpose (objective) of the 
Fellowship Program? 

2. Y/as this purpose congruent with your expectations ? Your needs ? 

3. Y r as there amply opportunity for vou to give feedback to those 
conducting the program? Did It change things? 

4. T n your opinion, did the practlcum experience literally provide 
a bond between theory and practice ? 

5 . Do you have any specific reactions to the team approach as used 
here ? 

'6. In your opinion, were the testing (evaluation) procedures closely 
related to the purpose cited above? 

7. What did you see as the strongest part of the program? Y/hay ? 

8. What did you see as the strongest part of the program? Why? 

9. What previous experiences — professional studies or on-the-job — 
were most valuable to you in view of. programmatic demands? 

10. Was there any particular type of preparation— l.e . , studies, 
work experience, travel, etc. — lacking in your background 
that proved to be a handicap during the past year ? 

11. What effects do you think the program has had on you as an 
ind ividual? 

12 . Yllhat effect do you believe the program will have on your 
professional career? 

iThe above Items were in the original protocol. Once Interviews were 
underway It became obvious that questions were needed regarding 
the group process approach and the manner in which participants 
became familiar with the announcement concerning the EXtep Program 
at Ohio University.' 
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THE SCHEDULE FOR THE PH.D. IN SECONDARY EDUCATION WITH 
A CONCENTRATION IN ECONOMIC EDUCATION 
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DEPARTMENT OF SECONDARY EDUCATION 
COLLEGE OF EDUCATION 
OHIO UNIVERSITY 
ATHENS, OHIO 



GUIDE FOR PLANNING A PH.D. IN SECONDARY EDUCATION 
WITH CONCENTRATION- IN ECONOMIC EDUCATION 



G eneral Require ments - (l 6 qhs minimum) Qu arter Hours 



Ed HE 590 Higher Education 4 
Ed HE 592 Teacher Education 4 
Ed RS 791 Advanced Seminar in Education I 4 
Ea RS 792 Advanced Seminar in Education II 4 
Ed RS 793 Advanced Seminar in Education III 4 



Secondary Educati on and Allie d Fields - (55 qhs. minimum) 



1 # Curriculum and Instruction - (24 qhs. minimum) 



Ed 


Av 


580 


Ed 


Av 


581 


Ed 


Se 


690 


Ed 


Se 


711 


Ed 


Se 


712 


Ea 


Se 


714 


Ed 


Se 


721 


Ed 


Se 


722 


Ed 


Se 


723 


Ed 


Se 


724 


Ed 


Se 


752 


Ed 


Se 


771 


Ed 


Se 


773 


Ed 


Se 


883 


Ed 


Se 


890 



Audio-Visual Methods and Materials 4 

Preparation of Audio-Visual Materials 4 
Research in Secondary Education VAR 

The High School Curriculum 4 

The Junior High- Middle School 4 

Curriculum 

Curriculum Theory in Secondary 5 

Education 



Research and Problems in Secondary. ) 
Education ) 

Research and Problems in Secondary ) 
Education Special Fields Curriculum) 
Research and Problems in Secondary ) 

Education Vocational Curriculum ) 

Research and Problems in Secondary ) 

Education Activities Curriculum ) 



Elect one 
5 



Practicum in Secondary Education - 4 

Social Studies 

Principles of Curriculum Organi- 
zation and Development 4 

Advanced Principles of Teaching 4 

Seminar in Secondary School 

Curriculum and Instruction 5 

Advanced Research in Secondary 

Education VAR 
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Research, Statistics, and Evaluation - (12 qhs, minimum) 



Ed 


RS 


711 


Techniques of Test Development 


r> 

O 


Ed 


RS 


712 


Educational Measurements 


4 


Ed 


RS 


72-0 


Education Statistics I 


5 


Ed 


RS 


721 


Educational Statistics II 


5 


Ed 


RS 


722 


Advanced Educational Statistics I 


4 


Ed 


RS 


723 


Advanced Educational Statistics II 


4 


Ed 


RS 


731 


Computer Science Applications in 










Education I 


5 


Ed 


RS 


732 


Computer Science Applications in 










Education II 


3 


Ed 


RS 


733 


Research Design. in Education 


4 


Ed' 


Se 


774 


Evaluation of Secondary Schools 


4 



Possible Electives 



a. Supervision and Administration 

Ed Ad 701 General School Administration 4 
Ed Ad 711 Fundamentals of Law in Education 4 
Ed Se 713 Secondary School Supervision 4 
Ed Ad 7^1 Principles of Education Finance 4 
Ed Ad 776 Supervision of Instruction 4 

b. Guidance 

Ed GS 530 Foundations of Guidance 4 
Ed GS 533 Guidance in the Junior High School 4 
Ed GS 534 Dynamics of the Adolescent 4 



c. Educational Foundations 



Ed EF 710 Advanced Social Foundations in 5 

Education 

Ed EF 711 Seminar: The Analysis of Edu- 
cational Roles 4 

Ed EF 714 Philosophies of Education 4 

Ed EF 715 Social Structure and Change in 

Education 3 



d. Psychology (Learning, Learning Theories, Psychology of 
Personality, Theories of Personality). 



Economics and E conom ic E ducation - 65 qhs. minimum). Each 
candidate must demonstrate competency through either under- 
graduate or graduate courses in the following areas: National 

Income Analysis, Micro- Economic Theory, Economic History, 
Comparative Economic Systems, Money and Banking, International 
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(3) 

.Economics, Public Finance, Economics of Human Resources, and - 
Labor Economics* This broad coverage (rather than a content 
specialization) is necessary to qualify the candidate as an 
economic education specialist. A candidate with little or 
no economics or economic education as an undergraduate should 
expect to be required to complete more than 65 quarter hours* 
The required courses will vary depending upon background, but, 
in general, a candidate must expect to complete the following 
courses or their equivalents: 

Econ 503 Advanced Micro- Economic Theory 
Econ 504 Advanced Micro- Economic Theory 
Econ 505 Economic History of the United 
States 

Econ 515 History of Economic Thought 
Econ 525 Comparative Economic Systems 
Econ 535 Introduction to Econometrics 
Ecori 563 Economics of ‘Government 
Econ 570 Labor Economics 
Econ 575 Economics of Poverty ( or Econ 

576) 

Econ 57 6 Economics of Human Resources 
(or Econ 575) 

Econ 58° International Economics 
Finance 55'1 Monetary Policy 
Finance 655 Seminar in Monetary Theory 

Economic Education 



Ec Ed 449-649 Economic Ed. Programs 3-5 

' Ec Ed 650-750 Economic Ed. Research 3-5 

Ec Ed 651-751 Economic Ed. Seminar 3-5 

Eo Ed 690 Studies in Economic Ed. (Ar) 



4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 



D. Additiona l Information and Requirements 

1. Each student is required to complete two scholarly 
disciplines, one of which is to be a modern foreign 
language . 

2. The practicum program in secondary education and economic 
education (EdSe 69 O and 752 and EcEd 690 ) are available for 
credit and will frequently help a student meet minimum 
course requirements to establish residency. 



3. 



The dissertation is assigned academic credit (15 qr. hrs. 
maximum) for state funding purposes. The student is ad- 
vised to consider the dissertation without reference to 
credit and to be aware. that in most oases the research 
undertaken as part of the dissertation may require a 
substantial time period. 
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I 



3 



o 

ERIC 



272 



262 



DEPARTMENT OF ECONOMIC EDUCATION 
COLLEGE OF BUSINESS ADMINISTRATION 
OHIO UNIVERSITY 
ATHENS, OHIO 

GUIDE FOR PLANNING AN 
M.A. IN ECONOMIC EDUCATION 

The program will be organized specifically for teachers who have a 
baccalaureate degree, a standard teaching certificate and who can meet 
the normal admission standards for the Graduate College of Ohio 
University. A 48-quarter hour program In economics and economic 
education will be coupled with curricular application demonstration 
projects . 

a) Courses In Economic Education 



A minimum of 12 quarter hours In economic education courses 
will be required of all candidates Including the Master’s 
Seminar or Thesis. The required courses are to be chosen 
by the student in consultation with his adviser and will be 
selected from the following courses: 



EcEd 446 
EcEd 547 

EcEd 548 

EcEd 649 
EcEd 651 
EcEd 691 
EcEd 693 
EcEd 695 
EcEd 697 
EcEd 698 
EcEd 699 



Economics In the Curriculum 

Economic Analysis and Its Application to the 

Curriculum 

Economic Policy and Its Application to the 
Curriculum 

Economic Education Programs 

Master's Seminar 

Economic Education Seminar 

Readings In Economic Education 

Economic Education Research 

Independent Research In Economic Education 

Internship 

Thesis 



Students with little or no background In economic education as 
undergraduages or as a part of their professional experience may be 
required to complete more than 12 hours. 

b) Academic Specialization 

A minimum of 27 quarter hours In economics will be required of 
all candidates. The areas of concentration, courses to be 
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taken, and hours required will depend upon what the student 
has had at the undergraduate level . The required courses In 
economics are to be chosen by the student In consultation 
with his adviser and will, In general, be selected from the 
following courses: 



Econ 503 
Econ 504 
Econ 505 
Econ 515 
Econ 525 
Econ 528 
Egon 530 
Econ 563 
Econ 570 
Econ 575 
Econ 576 
Econ 580 
Econ 692 



Advanced Micro-Economic Theory 
Advanced Macro-Economic Theory 
History of Economic Thought 
Economic History of the United States 
Comparative Economic Systems 
Regional Economics 

Introduction to Mathematical Economics 

Economics of Government (or Econ 440) 

Labor Economics 

Economics of Poverty 

Economics of Human Resources 

International Economics 

Seminar In Economics 



Each candidate must demonstrate competency through either 
undergraduate or graduate courses In the following areas: 
National Income Analysis, Micro-Economic- Theory, History 
of Economic Thought, Comparative Economic Systems, 
Statistics, Money and Banking, International Economics , 
Public Finance, and Labor Economics. This broad converage 
(rather than a content specialization) Is necessary to qualify 
the candidates as competent teachers of economics as a 
separate course In the secondary schools or as economic 
education curriculum consultants. Candidates with little 
or no economics as undergraduates may be required to 
complete more than 27 quarter hours . 



c) Related courses In professional education are to be chosen by 
the student in consultation with his adviser and will, In general, 
be selected from the following list of courses: 



Ed. 


GS 


530 


Ed. 


RS 


611 


Ed. 


RS 


612 


Ed. 


RS 


521 


Ed. 


RS 


673 



Foundations of Guidance 
High School Curriculum 
Educational Measurements 
Educational Statistics 
Advanced Principles of Teaching 
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THE RESPONSES OF THE FELLOWS TO THE 
PRACTICUM QUESTIONNAIRE 
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PRACTICUM EVALUATION 



NA ME KEY 

DATE March 9, 1970 



Key: 


SA (Strongly Agree); A (Agree); _? (Undecided); 




SD (Strongly Disagree); NR (No Response). 






SA A 2 


1. 


The objectives of the practicum 






were clear to me . 


6 12_ 2_ 


2. 


The objectives of the practicum 
seemed clear to the cooperating 






school personnel. 


3 12_ 4 


3. 


The objectives of the practicum 






were realistic. 


ill 


4. 


The practicum was a beneficial 






experience . 


_7_ _8_ _5_ 


5. 


Sessions, both formal and Informal, 
with thepracticum director were 






helpful. 


_9 3 2_ 


6. 


Sessions with the cooperating 






school personnel were helpful. 


_7_ 7 2 


7. 


Members of our team worked 






well together. 


10 _9_ _1_ 


8. 


I had no opportunity to express my 






Ideas during the practicum. 


1 0 1_ 


9. 


Our team often followed my ideas 






and suggestions . 


4 12 4 


10. 


The USOE should encourage 
practicum experiences for programs 






similar to this program. 


Jco 

h 


11. 


There should have been more 
opportunity provided for actual 






teaching . 


2 5 5 



D (Disagree); 
D SD NR 
1 0 0 



0_ 2 0 

2 0_ 0 

1 C 0 



1 0 0 

2 _ 1 2 
i g__o 

7 12 0 

1 0 0 



2 0 0 



8 1 0 
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SA A _? D SD NR 

12. Teams were formed In an efficient 

and satisfactory manner. 5 14 1 _1 0_ 0_ 

13. Teams were assigned to schools in 

an efficient and satisfactory manner. 4 12 2 2 _0_ 0 



14 . The practlcum was sufficiently 
flexible to allow and encourage 
creativity. 



7 12 1 1 0 0 



15 . Personnel in the cooperating schools 
were apprehensive of the team visits 

at first. _LJL° JLZ_1_ ± 



16 . Personnel in the cooperating schools 
appreciated the team's efforts by the 

end of the experience . J_ JO. JL J) L Q - 



17 . Personnel in the cooperating school 

were generally cooperative . 3 12 0 2 _L _JL 



1C. The practicum was too highly 
structured . 



0 0 2 16 3 0 



19 The practicu m provided an effective 
means for translating theory into 

practice . _JL _Z. _i. 4. _ _J_ _JL 

20. There was sufficient time scheduled 

In the ExTFP for the.practicum. 5 11 3 2 _0 0 



21 . Insufficient guidance throughout the 
practlcum made it. difficult to identify 

the task to be performed. 0_-2_2. J5. _2_ _0_ 



22. Interaction with other team members 
was beneficial to me . 



5 11 3 1 1 0 



23. Team leaders provided good 
leadership . 



10 5 2 1 1 o_ 



24 . The opportunity to work with the 

cooperating school was an enriching 

and broadening experience for me. _£ J1J _L JL 2 
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25. 


Cooperating school personnel 
contributed to the team's curriculum 
plans for that school . 


SA A ? 
J 8 _4_ 


D SD 
_5 0_ _ 


NR 

0 


26. 


Our team effort had or will have a 
definite impact on the social studies 
program of the cooperating school. 


_7 _5__6_ 


I _1 . 


0 


27. 


Cooperating school personnel 
resisted recommendations made by 
the practlcum team. 


_0_ JL_3_ 


J5 2 _ 


0 


28. 


Writing a contract for the practicum 
director and cooperating school 
personnel helped me to understand 
my own objectives. 


3 9 3 


l 0 _ 


0 


23. 


The practlcum experience helped 
me to learn economics content. 


4 12 0 


5 


0 


0 


30. 


The practicum experience gave me 
Ideas how to teach economics 
effectively. 


_4__13 _l_ 


_3_ _0_ 


0 


31. 


Given opportunity costs , course 
work should have been substituted 
for the practlcum. 




_8_ 


1 


0 


32. 


Cooperating school personnel 
contributed to the overall success 
of the practlcum. 

Economics course content at OU 
could readily be adopted for use in 
the practlcum. , 

I understand the place and purpose 
of the practlcum as a component of 
the total ExTFP. 


1 11 3 


5 


1 


0 


33. 


_3__10 _3_ 


4 0 


0 


34. 


_4 _14__3 


0 0 


0 


35. 


I understood my place and role on 
the team to which T was assigned. 


_6_14_! 


_0 _0_ 


0 
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36. 



37. 



38. 



39. 



40. 



41. 



42. 



43. 



44. 



45. 



46. 



SA A ? D SD NR 

I understood my place and role of 
the other members of the team to 

which I was assigned. . 5 14 1 0 0 0 



I understood the role of the 
cooperating school personnel in 

the practlcum experience. 2 14 3 1 0 0 



The cooperating school personnel 
understood their role in the 

practlcum experience. 1 11 6 2 0 0 



The practlcum director provided 
administrative support thoughout 
the practlcum. 

The number of actual hours (not 
course credit) spent for the 
practlcum was unreasonable. 

The practlcum prove;! to be an 
excellent educational opportunity 
for me. 

The practicum experience should 
have been scheduled later in the 
progra m . 



9 12 0 0 0 0 



0 0 2 17 2 0 



5 11 2 3 0 0 



2 5 3 9 2 0 



The practlcum experience could not 

have been accomplished in less than 

two quarters . 1 11 4 3 2 0 



The practlcum was successful in 
combining previous teaching with 
present course work to focus on a 



relevant experience . 8 6 _6_ 1 0 0 



My approach to curriculum design 
and change will be Influenced by 
my experiences in the practlcum. 


JL£ 


3 3 0 0 


Overall, team morale was high 
during the practlcum. 


J7_4 


5 4 10 
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47. 

48. 

49. 

50. 



51. 



52 



53, 



54 



55 



My attitude toward thepractlcum 
was generally positive. 

Students who audit a practicum 
course contribute as much as those 
who take It for credit. 



SA A ? D SD MR 



11 1 2 1 



3 5 9 4 2 



56. 



A major goal of the practicum was 
to analyze the social studies 

curriculum in the cooperating school. 2 7 4 6 0 

The materials developed by the 
practicum team are an improvement 
over existing materials In the 

cooperating school. _Z__9_4 L JL 



The practicum helped to make 
cooperating school personnel 
more aware of the place of 
economics In the curriculum. 

The resource personnel who 
addressed the economic 
education classes during the Fall 
Quarter provided ideas that were 
used for the practicum experience. 

The amount of academic credit (4 
hours per quarter for 2 quarters) 
was adequate for the work 
required . 

Students should not receive letter 
grades for practicum work. 

Ohio University offered adequate 
facilities for group meetings and 
planning sessions. 



7 11 



0 0 



1 11 3 5 0 



JLJIJ- JL JL 



2 19 6 4 



The cooperating school offered 

adequate facilities for group meetings 

and planning sessions. _L JL L -- 



2 16 2 _1 JO. 
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57, The availability of materials in 
the Curriculum Materials 
Laboratory contributed directly 
to the success of the practicum. 

58, The Dept, of Econ. Edu cation 
provided helpful and sufficient 
assistance and material for our 
team. 



59. The cooperating school supported 
the team effort by providing 
supplies and materials . 



The practicum experience involved an opportunity cost to all 
individuals associated with it. The cost to each Fellow was 
the sacrifice of two regular courses (eight credit hours) . Given 
this cost, how do you rate the two practicum courses offered 
during the Fall and Winter Quarters as an educational 
experience as compared to: 

(1) the two courses you judge to have been most valuable to you 
4 V ery Favorable; 5 F avorable; 3 A bout the Same; 

8 U nfavorable; 1 V ery Unfavorable . 



SA A ? D SD NR 



9 11 0 1 0 0 



9 10 2 0 0 0 



1 7 5 5 2 0 



and 

(2) the two courses you judge to have been the least valuable to 
you: 

8 V ery Favorable; 10 F avorable; 2 A bout the Same; 
1 U nfavorable; 0 Very Unfavorable. 
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THE RESPONSES OF THE PERSONNEL IN THE CO- 
OPERATING SCHOOLS TO THE PRACTICUM QUESTIONNAIRE 
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Key: 



1 . 



2 . 

3. 

4. 



5. 



6 . 



7. 



8 . 



9. 



10 . 



COOPERATING SCHOOL PERSONNEL 



Na me KEY 

Date April 27, 1970 

SA (Strongly Agree); A (Agree); ? (Undecided); D (Disagree; 

SD (Strongly Disagree); NR (No Response) . 

SA A ? D SD NR 

The objectives of the practlcum 
seemed clear to the practlcum 

team members. JL2. 2 2_ _0_ _0_ 



Sessions withpracticum team 

members were helpful to me. _18 2 2 0 _Q. 



Members of the practicum team 

worked well together . Jd 9_ 4. _3 0 0 



Practlcum team members should f 

have availed themselves of the 
opportunity for demonstration 

teaching.. JL_2 2. — - — 

The practlcum program seemed 
sufficiently flexible to encourage 

creativity. JL _L1 2 2 L — 

I was apprehensive of the team 

visits at first. ■ _3 _4_i. _Z_. Z_ 0 — 



I appreciated the practicum 
team's efforts by the end of 

the experience . .LLJLiS L _1_ 2. 

Insufficient guidance throughout 
the practicum made it difficult to 

identify the task to be performed. _ 2 __ 3 _ 4 15__4 0 

Team leaders provided good 

leadership. §_,9 _10 _L 2 2 

The opportunity to work with the 
practlcum team was a good 

educational experience for me. __13 3 1 0 _2 
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11. I contributed to the practicum 
team's curriculum plans for my 
school. 

12. The efforts of the practicum team 
had, or will have, a definite 
Impact on the social studies 
program of our school. 

13. The practicum experience gave 
me Ideas about how to teach 
economics effectively. 

14. I contributed to the overall 
success of the practicum. 

15. The practicum team members 
understood my role in the 
practicum. 

16. The number of hours that I spent 

for the practicum was unreasonable. _0__2__3_ 12. JJ 0 

17. My approach to curriculum design 
and change will be influenced by 
rny experiences with the practicum 

team. _L_ 2 JLJL J_ JL_0 

18. Overall, the morale of the practicum 

team was high. 12 14 2 0_ JO 0 

19. The practicum helped to make me 
more aware of the place of 

economics In the curriculum. _n _14__3_ -2 2 2. 

20. The time I spent on the practicum 
could have been used more 

effectively in other activities . _0_ _1 7 14 _6 0 



SA A ? JD_ _SD _NR 
J__n J3 2 0_ 0 

_ 9__9 6 2 _1 0 _ 

_ 6 _ _ 15 _ _4 3 _0 0 _ 

A ..2 2 _ 

2 14 9 2 1 0 
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SA A. ? D SD NR 

21. If a similar practicum experience 
were provided next year, T would 

be willing to cooperate again. _8_ 11 4 1 4 0 



How would you characterize your degree of Involvement In the 
practicum? (Check one) 



11 


1 . 


Very Involved 


10 


2. 


Moderately Involved 


4 


3. 


.Slightly involved 


3 


4. 


No reply 





APPENDIX G 

A FELLOW'S ASSESSMENT OF A PRACTICUM EXPERIENCE 




G 

ERIC 



286 



Www ii 



) 



APPENDIX G 



A FELLOW'S ASSESSMENT OF A PRACTICUM EXPERIENCE 



) 



9 

ERIC 



287 



ME 3E3W!rW>*i»»w» 



o 



I THE LANCASTER PRACTICUM PROJECT: 
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| AN ATTEMPT AT EVALUATION 



by 

Lewis Karstensson 
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It Is my intent, in this brief paper to takes a critical look at the 
economic education Practlcum Project that was conducted in the 
Lancaster City Schools during the 1969-70 school year. Underlying 
this review is the hope that is will contribute in some small way 
toward the end of establishing effective diplomatic relations between 
the Economic Education Department of Ohio University and the 
Lancaster City Schools so that the task of curriculum innovation can 
proceed with some desired results. 

The study is comprised of three central parts. First, we need to 
consider the plan that was constructed for the project which contains 
the objectives, procedures, and the desired outcomes for the task 
at hand. Second, we can gain some notion regarding the accomplish- 
ments and shortcomings of the project by comparing the overt results 
with what was Intended. And third, recommendations can be made on 
the basis of the recognized fallres of this project as well as a conscious 
ness of what yet needs to be done. 

I 

The plan for this practlcum project consisted of a set of specified 
(1) objectives defining the task of the Practlcum Team, ( 2 ) procedures 
amplifying the roles of both the Practlcum Team members as well as the 
Lancaster personnel Involved in the project, and (3) outcomes which 
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could reasonably result from the Project. Each of these dimensions of 
the plan is subject, of brief concern. 

Objectives 

The task, assumed by the Practlcum Team, consisted of assisting 
selected personnel of the Lancaster Schools^ in their effort to place the 
subject-matter of economics into their curriculum by making recommenda- 
tions regarding the selection and implementation of economic concepts 
pertinent to grades one through six. This task, in a more precise sense, 
involved recommending specific concepts in economics and alternative 
ways that they could be handled in the classroom. 

Procedure 

The procedure employed by the Practicum Team can be best understood 

by looking at its parts. First, the Team used a variety of resources to 

2 

perform its task; noteworthy curriculum materials and Ohio University 
personnel were tapped to Identify significant economic concepts and to 
glean how they might be taught. Second, once the concepts and pedogogy 
were Identified, this information was transferred in regularly scheduled 
meetings to the Lancaster teachers for their consideration, scrutiny. 



*See Appendix A. 
^ See Appendix B. 
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acceptance, or rejection. And third, those concepts and activities which 
appeared useful to the teachers were to be developed by them for their 
classroom use . 

Desired Outcome s 

The °racticum Team hoped that the project would produce the follow- 
ing results in the Lancaster City Schools: U) expand that group of 
teachers in grades one through six who are willing and able to teach 
economic concepts to their students; (2) create a group of teachers who 
are able and willing to pursue further the task of developing and imple- 
menting curricula in the field of economics; and (3) construct a useful 
economic education supplement to the Course of Study and Elementary 
Curriculum Guide . 

II 

What were the accomplishments and shortcomings of the Lancaster 
Project? Evidence indicates that little was achieved with regard to the 
desired outcomes indicated above. Only three of the ten Lancaster 
teachers attended the meetings regularly. And just two of the ten ex- 
hibited evidence that they were using the concepts and activities pre- 
sented by thePracticum Team. 3 Consequently, only marginal success— 
if that — was achieved in expanding the group of teachers in Lancaster 



^See Appendix A. 
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who are willing and able to work economics into their courses of study; 
and no success can be noted in the creation of a group who would further 
pursue curriculum development in economics much less construct an 
economic education guide . 

The cause of the failure of this Project in the absence of precise 
evaluative instruments is not known. However, it is possible to hypoth- 
esize about the cause, and I, therefore, offer the following general 
explanation: 

CDj-f (U, PT, LT, LA) 

where , 

CD, = the output of curriculum development in the Lancaster Schools 
in grades one through six; 

U=the input of the Department of Economic Education at Ohio 
University 

PT = the input of the Practlcum Team; 

LT = the input of the ten Lancaster teachers; and 

IA = the input of the administration of the Lancaster Schools. 

This relationship neans simply that the productivity of the Practicum 
Project in Lancaster is a direct function of the Inputs of four variables: 
the University, the Practicum Team, the teachers who participated in 
the Project, and the school district administration. If this general ex- 
planation is accepted then one can look at each of the Independent 
variables to determine possible flaws that might explain the failure. 

It will be helpful, also, to imagine that each variable is quantifiable. 
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It see "ns reasonable to argue that up to a point of diminishing 
returns , 

U=f (p 1# tj, m^ 

where , 

pj as productivity of the personnel of the Economic Education Depart- 
ment; 

tj = time devoted by this personnel to the Project; and 
mi = money spent on the Project. 

That is to say. If p and/or t and/or m Increased In magnitude then U 
would increase by some amount, and consequently CDj would rise, other 
things being held constant. This analysis of the U variable suggests 
that the failure of the Lancaster Project may have been influenced by in- 
sufficient human capital, time, or money spent by the Economic Educa- 
tion Department on the Project. 

One can argue in a similar fashion that, 

PT=f (p2 , t 2 ) 

where , 

P 2 = productivity of the Practicum Team; and 
t 2 = time devoted to the Project. 

Here, if p and/or t were increased then PT would rise as would CDj. The 
hypothesis to be drawn from consideration of this variable is that the 
Project failed because of the low productivity of the Practicum Team or 
that too little time was spent by the Team on the effort. 

In like fashion, it is reasonable to say that, 

LT=f(P3 # tg) 
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where , 



p 3 = productivity of the ten Lancaster teachers; and 
t 3 = the time which they spent on the Project. 

Since LT and CDj would rise with Increases in p and/or t, it is possible 

that the Practicum effort failed because the input of the Lancaster teachers 

was too sparce. 

Finally, if one accepts the notion that, 

LA=f(p 4 , t 4 , m 4 ) 

where , 

p 4 = productivity of the Lancaster District Administration; 

t 4 = time devoted by the administration on the Project; and 
m 4 = quantity of district funds spent on the effort, 

then the possibility that the curriculum Project failed because too few 

resources were put into it by the School Administration becomes apparent. 

This analysis suggests four hypotheses which collectively explain 

the low level of accomplishment in the Lancaster Schools, and some 

casual emperical evidence tends to support three of the theses. Consider, 

first the PT variable. Throughout the Project, I gathered the impression 

that the members of the Practicum Team, myself included, arranged their 

priorities toward work in such a way that their academic courses were 

more important than the Practicum. Hence there seems to have been in 

motion a process of robbing Peter to pay Paul and the Practicum was 
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Peter, This should not be taken to nnean that little effort was put into 
the Project by the Team; something substantial was prepared for each 
meeting, but It was not as refined as It might have been. Nevertheless, 
the PT variable was reduced to the extent that Peter was robbed. 

The second hypothesis which Is supported by some evidence is 
the one centering around the LT variable. The performance record of 
the teachers noted earlier In this paper reflects very little input by 
this group, so the magnitude of LT Is certainly not large. This per- 
formance might have been expected of the teachers, however, since 
they undertook (or perhaps they were assigned to) the Project without 
significant relief from their other presumably full-time duties. 

Finally, evidence Is consistent with the notion that the LA 
variable was low in magnitude. After the Initial meeting or two there 
was no apparent administrative participation In the Project; the time 
factor contributing to LA was nearly zero. In addition, no significant 
monetary support was given to the Project by the School District; the 
money factor Influencing LA was kept above zero only by an occasional 
long-distance telephone call or the cost of a substitute teacher. What 
this evidence amounts to is the fact that there existed no real committ- 
ment on the part of the administration to the Practicum Project. 
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In light of the foregoing analysis It Is clear that the desired out- 
comes of the Project were too ambitious for the effort that the various 
parties involved were willing to expend. Yet given the notion that 
economic understanding is valuable, these outcomes seem to m© to be 
the very minimum that ought to be achieved. If, then, these goals are 
to be sought after through the medium of a practicum sometime in the 
future, two recommendations logically eminate from the preceeding 
analysis of the past experience. First and foremost, a real committment 
must be obtained from the administration of the School District. Such 
a committment consists of time to provide leadership in directing and 
coordinating such a project as well as money to free teachers so that 
they can work on the effort without having to perform a full-time job, too. 
And secondly, I recommend that any future pract.lcum be conducted during 
a time period when the team members are not Involved in academic 

courses. This would eliminate the robbing Peter to pay Paul effect. And 

it could perhaps be achieved by setting aside one quarter devoted ex- 
clusively to such a project. It seems reasonable to expect that CDj 
would increase with the implementation of these recommendations. 
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APPENDIX A* 

Members of the Lancaster Practicum Team were: 
Mr. Richard Berge, Team Leader 
Mr. Charles Russell 
Mr. Lewis Karstensson 



The Committee of Lancaster Teachers included the following members: 



Mrs .. Bo'/er * 

Mrs . Campbell 
Mrs . Conrad 
Mr. Greve 
Mrs. Kennedy 
Mrs. Kessler * # 
Mrs. Rice 
Miss Van Horn * # 
Mr. Weber 
Mr. Woodgeard 



* = attended meetings 

regularly 

# = presented evidence of 

their having used con- 
cepts and activities 
in their classes 




*N,B.: This is an appendix to the Karstensson Report — editor. 




APPENDIX B* 



The following is a list of curriculum materials used by the 
Team from which concepts and activities were drawn. 



Davison, Donald G. and Kilgore, John H. The Child's World of 
Choices . Iowa City: The University of Iowa, 1968. (An 
economic education guide for grades K-3.) 

Economic Education Project Staff. Economic Education: A Supplement 
to the Social Studies Guide. Minneapolis: Minneapolis Public 
Schools, 1967. 3 volumes. (A guide for grades K-6.) 

Little Rock Public Schools, Arkansas State Council on Economic 

Education, and Arkansas State Department of Education. Economic 
Education for Arkansas Elementary Schools, Teaching Guide , 1969, 
(Not organized by grade levels .) 

Office of the State Superintendent of Public Instruction. Economic 

Education for Washington Schools. Olympia: Superintendent of 
Public Instruction, 1966. (A guide for grades K-6.) 

Senesh, Lawrence. Our Working World . Chicago: Science Research 
Associates, 1967. (A Social studies program for grades 1-3.) 

The Kazanjian Foundation Awards Program Reports. 6 volumes . 

(Specific projects used in the teaching of economics at 
elementary, secondary, and college levels.) 



*N.B.: This is an appendix to the Karstensson Report — editor. 



APPENDIX H 



A REPORT OF THE GROUP PROCESS EXPERIENCE 



Vs- 
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OHIO UNIVERSITY 



INTER-OFFICE COMMUN I CATION 

DATE : July 9, 1970 

TO : Jerry Draayer ' ■ 

FROM : Ed Trcinb 1 ey end J im Grubb 



SUBJECT; Grou p Process for the ExTFP 



During September, 1969, the twenty two (22) fellows in the ExTF program 
were divided into two groups of seven each and one group of eight * Each 
of the three groups were seen on a daily basis for six days* The daily 
meetings ran for approximately three hours per group e This came to a 
total of approximately eighteen (18) hours of group process experience per 
group during the interim week between Summer Session 1969 and Fall quarter 
1969* One group of seven was seen by Dr* Tremblay, one group of seven 
was seen by Dr* Grubb, and the group of eight was seen by both Dr* Trem- 
bley and Dr* Grubb c In addition to the group meetings, an individual 
conference for each of the twenty two fellows was held by the two con- 
sultants* 

The original plans had called for a group session each month from October, 
1969, to May, 1970; however, the content of the group sessions during the 
initial week and the variation of class schedules for the fellows made it 
inappropriate and impractical to hold the monthly group sessions* Initial 
efforts were made to try to follow this plan and two monthly sessions were 
held which resulted in low attendance and resistance to the group process 
experience* This resistance was in part clearly due to the fellows' heavy 
involvement in their academic work* When these conditions became apparent 
the group process consultants altered the procedure to an individual coun- 
seling approach based on the fellows 1 demand and availability* 

The following description of activities is presented on a time involvement 
basis and on general problems and concerns rather than on individual per- 
sonalities* Approximately 100 hours were provided in individual counseling 
time to the ExTF program by the consultants* Twelve of the fellows did 
not seek individual counseling from either of the consultants; however, 
individual counseling was provided by the consultants for the other ten 
fellows o Five of these ten who sought counseling were seen from one to 
five hours per person, four were seen from six to ten hours per person, and 
one was seen for almost 40 hours of individual counseling* 

In order to respect the commitment to confidentiality given by the consul- 
tants to the fellows who came for individual counseling, no mention should 
be made of any of the personal concerns which were presented at those coun- 
seling sessions* In many cases these were personal concerns that were often 



